Nov 05 22:07:51 devstack cinder-volume[76064]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 22:07:51 devstack cinder-volume[76064]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 22:07:51 devstack cinder-volume[76064]: we strongly recommend against using it for new projects. Nov 05 22:07:51 devstack cinder-volume[76064]: If you are already using Eventlet, we recommend migrating to a different Nov 05 22:07:51 devstack cinder-volume[76064]: framework. For more detail see Nov 05 22:07:51 devstack cinder-volume[76064]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 22:07:51 devstack cinder-volume[76064]: import eventlet # noqa Nov 05 22:07:54 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:07:54 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:07:54 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:07:55 devstack cinder-volume[76064]: INFO dbcounter [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Registered counter for database cinder Nov 05 22:07:55 devstack cinder-volume[76064]: DEBUG oslo_db.sqlalchemy.engines [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:07:55 devstack cinder-volume[76064]: DEBUG dbcounter [-] [76064] Writer thread running {{(pid=76064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:07:55 devstack cinder-volume[76064]: INFO cinder.rpc [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 22:07:55 devstack cinder-volume[76064]: INFO cinder.rpc [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_db.sqlalchemy.engines [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:07:56 devstack cinder-volume[76064]: INFO cinder.volume.manager [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Determined volume DB was empty at startup. Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG cinder.volume.manager [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76064) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 22:07:56 devstack cinder-volume[76064]: INFO cinder.volume.manager [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 22:07:56 devstack cinder-volume[76064]: WARNING stevedore.named [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 22:07:56 devstack cinder-volume[76064]: WARNING castellan.key_manager [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:07:56 devstack cinder-volume[76064]: WARNING cinder.keymgr.conf_key_mgr [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG cinder.volume.drivers.lvm [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76064) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_concurrency.processutils [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_concurrency.processutils [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] CMD "cinder-rtstool verify" returned: 0 in 0.410s {{(pid=76064) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_db.sqlalchemy.engines [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:07:56 devstack cinder-volume[76064]: INFO cinder.rpc [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 22:07:56 devstack cinder-volume[76064]: INFO cinder.rpc [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 05 22:07:56 devstack cinder-volume[76064]: WARNING stevedore.named [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 22:07:56 devstack cinder-volume[76064]: WARNING castellan.key_manager [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:07:56 devstack cinder-volume[76064]: INFO cinder.volume.manager [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_db.sqlalchemy.engines [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76064) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:07:56 devstack cinder-volume[76064]: INFO oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Starting 1 workers Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Started child 76226 {{(pid=76064) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Full set of CONF: {{(pid=76064) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] ******************************************************************************** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Configuration options gathered from: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] ================================================================================ {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] allow_availability_zone_fallback = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76226]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] allow_compression_on_image_upload = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] allowed_direct_url_schemes = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] api_rate_limit = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] auth_strategy = keystone {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] az_cache_duration = 3600 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_availability_zone = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_host = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_stats_polling_interval = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backup_api_class = cinder.backup.api.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backup_name_template = backup-%s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backup_use_same_host = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backup_use_temp_snapshot = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] chap_password = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] chap_username = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cinder_internal_tenant_project_id = 5c8f02e4139046a98a6c223da316509c {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cinder_internal_tenant_user_id = 4fd31888469a4c01a4d66abc32994f21 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cloned_volume_same_az = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cluster = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] compression_format = gzip {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] compute_api_class = cinder.compute.nova.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] config_dir = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] config_source = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] control_exchange = openstack {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] debug = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] default_availability_zone = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] default_group_type = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] default_volume_type = lvmdriver-1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] disk_geometry = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] driver_client_cert = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] driver_client_cert_key = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] driver_data_namespace = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] driver_ssl_cert_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] driver_ssl_cert_verify = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] driver_use_ssl = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] enable_force_upload = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] enable_new_services = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] enable_unsupported_driver = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] enforce_multipath_for_image_xfer = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] filter_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance_api_insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance_api_servers = ['http://192.168.122.30/image'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance_api_ssl_compression = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance_ca_certificates_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance_catalog_info = image:glance:publicURL {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance_certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance_keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance_num_retries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance_request_timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] goodness_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] graceful_shutdown_timeout = 5 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] group_api_class = cinder.group.api.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] host = devstack {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_compress_on_upload = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_conversion_address_space_limit = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_conversion_cpu_limit = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_conversion_disable = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_introspection_address_space_limit = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_introspection_cpu_limit = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_upload_use_cinder_backend = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_upload_use_internal_tenant = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_volume_cache_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_volume_cache_max_count = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] image_volume_cache_max_size_gb = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] init_host_max_objects_retrieval = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] instance_format = [instance: %(uuid)s] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] iscsi_target_flags = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] iscsi_write_cache = on {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] iser_helper = tgtadm {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] iser_ip_address = 192.168.122.30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] iser_port = 3260 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] log_color = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] log_config_append = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] log_dir = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] log_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] log_options = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] log_rotate_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] log_rotate_interval_type = days {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] log_rotation_type = none {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] max_age = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] max_logfile_count = 30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] max_logfile_size_mb = 200 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] max_over_subscription_ratio = 20.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] message_reap_interval = 86400 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] message_ttl = 2592000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76226]: INFO cinder.volume.manager [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 22:07:56 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] migration_create_volume_timeout_secs = 300 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] monkey_patch = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] monkey_patch_modules = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] my_ip = 192.168.122.30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] no_snapshot_gb_quota = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] num_iser_scan_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] num_shell_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] num_volume_device_scan_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] nvmeof_conn_info_version = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] nvmet_ns_id = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] nvmet_port_id = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] osapi_max_limit = 1000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] osapi_volume_ext_list = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] osapi_volume_listen_port = 8776 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] osapi_volume_use_ssl = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] osapi_volume_workers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] per_volume_size_limit = -1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] periodic_fuzzy_delay = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] periodic_interval = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] public_endpoint = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:56 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] publish_errors = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] quota_backup_gigabytes = 1000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] quota_backups = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] quota_gigabytes = 1000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] quota_groups = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] quota_snapshots = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] quota_volumes = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] rate_limit_burst = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] rate_limit_except_level = CRITICAL {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] rate_limit_interval = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] reinit_driver_count = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] replication_device = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] report_discard_supported = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] report_interval = 120 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] reservation_clean_interval = 86400 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] reservation_expire = 86400 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] reserved_image_namespaces = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] reserved_percentage = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] rpc_response_timeout = 120 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] run_external_periodic_tasks = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] scst_target_driver = iscsi {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] scst_target_iqn_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_down_time = 720 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] shell_completion = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] snapshot_name_template = snapshot-%s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] snapshot_same_host = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] split_loggers = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] state_path = /opt/stack/data/cinder {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] storage_availability_zone = nova {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] storage_protocol = iSCSI {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] syslog_log_facility = LOG_USER {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] target_helper = lioadm {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] target_ip_address = 192.168.122.30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] target_port = 3260 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] target_protocol = iscsi {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] target_secondary_ip_addresses = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] trace_flags = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] transport_url = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] until_refresh = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] use_chap_auth = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] use_default_quota_class = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] use_journal = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:56 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] use_json = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] use_multipath_for_image_xfer = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] use_stderr = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] use_syslog = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] verify_glance_signatures = enabled {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_api_class = cinder.volume.api.API {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_backend_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_clear = zero {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_clear_ionice = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_clear_size = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_copy_bps_limit = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_dd_blocksize = 1M {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_name_template = volume-%s {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_service_inithost_offload = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volume_usage_audit_period = month {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] zoning_mode = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_concurrency.disable_process_locking = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.auth_section = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.auth_type = password {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.auth_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.cache = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.include_service_catalog = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.interface = public {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_password = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcache_username = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack sudo[76230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.region_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack sudo[76230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.service_type = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.30/identity {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.backend = dogpile.cache.null {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.backend_argument = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.backend_expiration_time = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.config_prefix = cache.oslo {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:56 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.debug_cache_backend = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.enable_retry_client = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.enable_socket_keepalive = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.expiration_time = 600 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.hashclient_retry_attempts = 2 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.memcache_dead_retry = 300 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.memcache_pool_maxsize = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.memcache_sasl_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.password = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.proxies = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.redis_db = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.redis_server = localhost:6379 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.retry_attempts = 2 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.retry_delay = 0.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.socket_keepalive_count = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.socket_keepalive_idle = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.socket_keepalive_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.socket_timeout = 1.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.tls_allowed_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.tls_cafile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.tls_certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.tls_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.tls_keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cache.username = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] coordination.backend_url = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.asyncio_connection = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.asyncio_slave_connection = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.backend = sqlalchemy {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.connection = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.connection_debug = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.connection_parameters = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.connection_recycle_time = 3600 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.connection_trace = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.db_inc_retry_interval = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.db_max_retries = 20 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.db_max_retry_interval = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.db_retry_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.max_overflow = 50 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.max_pool_size = 5 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.max_retries = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.mysql_wsrep_sync_wait = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.pool_timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.retry_interval = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.slave_connection = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.sqlite_synchronous = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.synchronous_reader = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] database.use_db_reconnect = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_tracing.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.connection_string = messaging:// {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.es_doc_type = notification {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.es_scroll_size = 10000 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.es_scroll_time = 2m {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.filter_error_trace = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.hmac_keys = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.sentinel_service_name = mymaster {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.socket_timeout = 0.1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.trace_requests = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler.trace_sqlalchemy = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler_jaeger.process_tags = {} {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler_jaeger.service_name_prefix = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] profiler_otlp.service_name_prefix = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_policy.enforce_new_defaults = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_policy.policy_default_rule = default {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_policy.policy_file = policy.yaml {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] privsep_osbrick.group = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] privsep_osbrick.helper_command = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] privsep_osbrick.user = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cinder_sys_admin.group = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cinder_sys_admin.helper_command = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] cinder_sys_admin.user = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.auth_section = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.auth_type = password {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.cafile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.collect_timing = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.send_service_user_token = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.split_loggers = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.tls_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] service_user.tls_min_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.auth_section = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.auth_type = password {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.collect_timing = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.region_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.split_loggers = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.tls_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] glance.tls_min_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.backend_availability_zone = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.chap_password = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.chap_username = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.disk_geometry = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.driver_client_cert = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.driver_client_cert_key = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.driver_data_namespace = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.driver_use_ssl = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.extra_capabilities = {} {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.filter_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.goodness_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.iscsi_target_flags = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.iscsi_write_cache = on {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.iser_helper = tgtadm {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.iser_ip_address = 192.168.122.30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.iser_port = 3260 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.lvm_share_target = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.lvm_type = auto {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.num_shell_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.replication_device = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.report_discard_supported = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.reserved_percentage = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.target_helper = tgtadm {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.target_ip_address = 192.168.122.30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.target_port = 3260 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.target_protocol = iscsi {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.trace_flags = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.unique_fqdn_network = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.use_chap_auth = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.volume_backend_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.volume_clear = zero {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.volume_clear_ionice = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.volume_clear_size = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_reports.file_event_handler = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_reports.log_dir = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.backend_host = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.chap_password = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.chap_username = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.disk_geometry = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.driver_client_cert = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.extra_capabilities = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.filter_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.goodness_function = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.iser_helper = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.iser_ip_address = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.iser_port = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.lvm_share_target = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.lvm_type = auto {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.num_shell_tries = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.replication_device = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.report_discard_supported = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.reserved_percentage = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.scst_target_driver = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.storage_protocol = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.target_helper = lioadm {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.target_ip_address = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.target_port = 3260 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.trace_flags = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.use_chap_auth = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.volume_clear = zero {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.volume_clear_size = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] lvmdriver-1.volumes_dir = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.ssl = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_notifications.driver = [] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_notifications.retry = -1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] key_manager.fixed_key = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.barbican_api_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.barbican_endpoint = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.barbican_endpoint_type = public {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.barbican_region_name = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.cafile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.collect_timing = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.number_of_retries = 60 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.retry_delay = 1 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.send_service_user_token = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.split_loggers = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.tls_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.tls_min_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.verify_ssl = True {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican.verify_ssl_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.auth_section = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.auth_type = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.cafile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.certfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.collect_timing = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.insecure = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.keyfile = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.split_loggers = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.timeout = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.tls_ciphers = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] barbican_service_user.tls_min_version = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.approle_role_id = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.approle_secret_id = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.auth_method = approle {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.auth_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.kv_mountpoint = secret {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.kv_path = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.kv_version = 2 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.namespace = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.root_token_id = **** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.ssl_ca_crt_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.timeout = 60.0 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.token_file = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.token_role = None {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.use_ssl = False {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:07:57 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] ******************************************************************************** {{(pid=76064) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 22:07:57 devstack sudo[76230]: pam_unix(sudo:session): session closed for user root Nov 05 22:07:57 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.387s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:57 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:57 devstack sudo[76302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:07:57 devstack sudo[76302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:07:57 devstack sudo[76302]: pam_unix(sudo:session): session closed for user root Nov 05 22:07:57 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.331s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:57 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:07:57 devstack cinder-volume[76226]: INFO cinder.brick.local_dev.lvm [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 22:07:57 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:57 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:57 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:57 devstack sudo[76424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:07:57 devstack sudo[76424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:07:58 devstack sudo[76424]: pam_unix(sudo:session): session closed for user root Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG cinder.brick.local_dev.lvm [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76226) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:58 devstack sudo[76507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:07:58 devstack sudo[76507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:07:58 devstack sudo[76507]: pam_unix(sudo:session): session closed for user root Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.531s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:58 devstack sudo[76711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:07:58 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:07:58 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:58 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:58 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 22:07:58 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:07:59 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Nov 05 22:07:59 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.290s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:59 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:59 devstack sudo[76845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:07:59 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:07:59 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root Nov 05 22:07:59 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:59 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:59 devstack sudo[76902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:07:59 devstack sudo[76902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:07:59 devstack sudo[76902]: pam_unix(sudo:session): session closed for user root Nov 05 22:07:59 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:07:59 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:07:59 devstack sudo[76933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:07:59 devstack sudo[76933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:00 devstack sudo[76933]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:00 devstack sudo[76942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:00 devstack sudo[76942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:00 devstack sudo[76942]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:00 devstack sudo[77026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:00 devstack sudo[77026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:00 devstack sudo[77026]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:00 devstack cinder-volume[76226]: INFO cinder.volume.drivers.lvm [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:00 devstack sudo[77030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:00 devstack sudo[77030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:00 devstack sudo[77030]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG cinder.volume.drivers.lvm [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Updating volume stats {{(pid=76226) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:08:00 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:00 devstack sudo[77033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:08:00 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:01 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:01 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:01 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:01 devstack sudo[77042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:01 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:01 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:01 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:01 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:01 devstack sudo[77045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:01 devstack sudo[77045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:01 devstack sudo[77045]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:01 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:01 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:01 devstack sudo[77049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:01 devstack sudo[77049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:02 devstack sudo[77049]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:02 devstack cinder-volume[76226]: INFO cinder.volume.driver [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG cinder.volume.driver [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76226) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG oslo_db.sqlalchemy.engines [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76226) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG dbcounter [-] [76226] Writer thread running {{(pid=76226) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG cinder.db.api [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Building query based on filter {{(pid=76226) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG cinder.image.image_utils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76226) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 22:08:02 devstack cinder-volume[76226]: INFO cinder.keymgr.migration [None req-e0d881e4-783d-4ed2-954c-be4323b95fd0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG cinder.volume.drivers.lvm [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Updating volume stats {{(pid=76226) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:02 devstack sudo[77052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:08:02 devstack sudo[77052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:02 devstack sudo[77052]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:02 devstack sudo[77057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:02 devstack sudo[77057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:02 devstack sudo[77057]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:02 devstack sudo[77060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:02 devstack sudo[77060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:02 devstack sudo[77060]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:02 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:03 devstack sudo[77063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:03 devstack sudo[77063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:03 devstack sudo[77063]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:03 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:03 devstack cinder-volume[76226]: DEBUG cinder.manager [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Notifying Schedulers of capabilities ... {{(pid=76226) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:08:03 devstack cinder-volume[76226]: INFO cinder.volume.manager [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Driver initialization completed successfully. Nov 05 22:08:03 devstack cinder-volume[76226]: INFO cinder.manager [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Initiating service 2 cleanup Nov 05 22:08:03 devstack cinder-volume[76226]: INFO cinder.manager [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Service 2 cleanup completed. Nov 05 22:08:03 devstack cinder-volume[76226]: DEBUG cinder.service [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Creating RPC server for service cinder-volume {{(pid=76226) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 22:08:03 devstack cinder-volume[76226]: DEBUG cinder.service [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76226) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 22:08:03 devstack cinder-volume[76226]: INFO cinder.volume.manager [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 22:08:03 devstack cinder-volume[76226]: DEBUG cinder.volume.drivers.lvm [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Updating volume stats {{(pid=76226) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:08:03 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:03 devstack sudo[77067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:08:03 devstack sudo[77067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:03 devstack sudo[77067]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:03 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:03 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:03 devstack sudo[77072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:03 devstack sudo[77072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:04 devstack sudo[77072]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:04 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:04 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:04 devstack sudo[77075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:04 devstack sudo[77075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:04 devstack sudo[77075]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:04 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:04 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:04 devstack sudo[77078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:04 devstack sudo[77078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:04 devstack sudo[77078]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:04 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:04 devstack cinder-volume[76226]: INFO cinder.volume.manager [None req-987ffcb1-3fc0-492f-b7d1-76a8d826e934 None None] Driver post RPC initialization completed successfully. Nov 05 22:08:06 devstack cinder-volume[76064]: DEBUG dbcounter [-] [76064] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76064) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:08:14 devstack cinder-volume[76226]: DEBUG dbcounter [-] [76226] Writing DB stats cinder:SELECT=4 {{(pid=76226) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:08:14 devstack cinder-volume[76226]: DEBUG dbcounter [-] [76226] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76226) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:08:21 devstack cinder-volume[76226]: DEBUG oslo_service.periodic_task [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running periodic task VolumeManager._thread_info {{(pid=76226) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:08:21 devstack cinder-volume[76226]: DEBUG cinder.volume.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] thread count: 6 {{(pid=76226) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:08:21 devstack cinder-volume[76226]: DEBUG cinder.volume.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] thread info: [<_MainThread(MainThread, started 135730034147456)>, , , , , ] {{(pid=76226) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:09:21 devstack cinder-volume[76226]: DEBUG oslo_service.periodic_task [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76226) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:09:21 devstack cinder-volume[76226]: DEBUG cinder.volume.drivers.lvm [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Updating volume stats {{(pid=76226) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:09:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:09:21 devstack sudo[79617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:09:21 devstack sudo[79617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:09:21 devstack sudo[79617]: pam_unix(sudo:session): session closed for user root Nov 05 22:09:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:09:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:09:21 devstack sudo[79622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:09:21 devstack sudo[79622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:09:22 devstack sudo[79622]: pam_unix(sudo:session): session closed for user root Nov 05 22:09:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:09:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:09:22 devstack sudo[79625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:09:22 devstack sudo[79625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:09:22 devstack sudo[79625]: pam_unix(sudo:session): session closed for user root Nov 05 22:09:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:09:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:09:22 devstack sudo[79628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:09:22 devstack sudo[79628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:09:22 devstack sudo[79628]: pam_unix(sudo:session): session closed for user root Nov 05 22:09:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:09:22 devstack cinder-volume[76226]: DEBUG cinder.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Notifying Schedulers of capabilities ... {{(pid=76226) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:09:22 devstack cinder-volume[76226]: DEBUG oslo_service.periodic_task [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running periodic task VolumeManager._thread_info {{(pid=76226) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:09:22 devstack cinder-volume[76226]: DEBUG cinder.volume.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] thread count: 6 {{(pid=76226) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:09:22 devstack cinder-volume[76226]: DEBUG cinder.volume.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] thread info: [<_MainThread(MainThread, started 135730034147456)>, , , , , ] {{(pid=76226) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:10:14 devstack cinder-volume[76226]: DEBUG dbcounter [-] [76226] Writing DB stats cinder:SELECT=1 {{(pid=76226) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:10:14 devstack cinder-volume[76226]: DEBUG dbcounter [-] [76226] Writing DB stats cinder:UPDATE=1 {{(pid=76226) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:10:21 devstack cinder-volume[76226]: DEBUG oslo_service.periodic_task [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76226) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:10:21 devstack cinder-volume[76226]: DEBUG cinder.volume.drivers.lvm [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Updating volume stats {{(pid=76226) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:10:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:10:21 devstack sudo[83021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:10:21 devstack sudo[83021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:10:21 devstack sudo[83021]: pam_unix(sudo:session): session closed for user root Nov 05 22:10:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:10:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:10:21 devstack sudo[83025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:10:21 devstack sudo[83025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:10:22 devstack sudo[83025]: pam_unix(sudo:session): session closed for user root Nov 05 22:10:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:10:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:10:22 devstack sudo[83029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:10:22 devstack sudo[83029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:10:22 devstack sudo[83029]: pam_unix(sudo:session): session closed for user root Nov 05 22:10:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:10:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:10:22 devstack sudo[83199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:10:22 devstack sudo[83199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:10:22 devstack sudo[83199]: pam_unix(sudo:session): session closed for user root Nov 05 22:10:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:10:22 devstack cinder-volume[76226]: DEBUG cinder.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Notifying Schedulers of capabilities ... {{(pid=76226) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:10:22 devstack cinder-volume[76226]: DEBUG oslo_service.periodic_task [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running periodic task VolumeManager._thread_info {{(pid=76226) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:10:22 devstack cinder-volume[76226]: DEBUG cinder.volume.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] thread count: 6 {{(pid=76226) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:10:22 devstack cinder-volume[76226]: DEBUG cinder.volume.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] thread info: [<_MainThread(MainThread, started 135730034147456)>, , , , , ] {{(pid=76226) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:11:21 devstack cinder-volume[76226]: DEBUG oslo_service.periodic_task [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76226) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:11:21 devstack cinder-volume[76226]: DEBUG cinder.volume.drivers.lvm [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Updating volume stats {{(pid=76226) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:11:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:11:21 devstack sudo[85059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:11:21 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:11:21 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root Nov 05 22:11:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:11:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:11:21 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:11:21 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:11:22 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Nov 05 22:11:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:11:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:11:22 devstack sudo[85072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:11:22 devstack sudo[85072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:11:22 devstack sudo[85072]: pam_unix(sudo:session): session closed for user root Nov 05 22:11:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:11:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:11:22 devstack sudo[85085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:11:22 devstack sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:11:22 devstack sudo[85085]: pam_unix(sudo:session): session closed for user root Nov 05 22:11:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:11:22 devstack cinder-volume[76226]: DEBUG cinder.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Notifying Schedulers of capabilities ... {{(pid=76226) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:12:14 devstack cinder-volume[76226]: DEBUG dbcounter [-] [76226] Writing DB stats cinder:SELECT=1 {{(pid=76226) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:12:14 devstack cinder-volume[76226]: DEBUG dbcounter [-] [76226] Writing DB stats cinder:UPDATE=1 {{(pid=76226) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:12:19 devstack cinder-volume[76064]: INFO oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Caught SIGTERM, stopping children Nov 05 22:12:19 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Acquiring lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:12:19 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Acquired lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:12:19 devstack cinder-volume[76064]: DEBUG oslo_concurrency.lockutils [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Releasing lock "singleton_lock" {{(pid=76064) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:12:19 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Stop services. {{(pid=76064) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 22:12:19 devstack cinder-volume[76064]: DEBUG oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Killing children. {{(pid=76064) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 22:12:19 devstack cinder-volume[76064]: INFO oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Waiting on 1 children to exit Nov 05 22:12:21 devstack cinder-volume[76226]: DEBUG oslo_service.periodic_task [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76226) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:12:21 devstack cinder-volume[76226]: DEBUG cinder.volume.drivers.lvm [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Updating volume stats {{(pid=76226) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:12:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:21 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:12:21 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:21 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:21 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:21 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:12:21 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:22 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:22 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:12:22 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:22 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:22 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:12:22 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:22 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:22 devstack cinder-volume[76226]: DEBUG oslo_concurrency.processutils [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76226) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:22 devstack cinder-volume[76226]: DEBUG cinder.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Notifying Schedulers of capabilities ... {{(pid=76226) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:12:22 devstack cinder-volume[76226]: DEBUG oslo_service.periodic_task [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] Running periodic task VolumeManager._thread_info {{(pid=76226) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:12:22 devstack cinder-volume[76226]: DEBUG cinder.volume.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] thread count: 6 {{(pid=76226) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:12:22 devstack cinder-volume[76226]: DEBUG cinder.volume.manager [None req-4d08ab7c-4ccf-46de-a6f6-912d77abb3c6 None None] thread info: [<_MainThread(MainThread, started 135730034147456)>, , , , , ] {{(pid=76226) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:12:23 devstack cinder-volume[76226]: DEBUG oslo_concurrency.lockutils [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Acquiring lock "singleton_lock" {{(pid=76226) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:12:23 devstack cinder-volume[76226]: DEBUG oslo_concurrency.lockutils [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Acquired lock "singleton_lock" {{(pid=76226) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:12:23 devstack cinder-volume[76226]: DEBUG oslo_concurrency.lockutils [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Releasing lock "singleton_lock" {{(pid=76226) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:12:23 devstack cinder-volume[76226]: WARNING amqp [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 22:12:23 devstack cinder-volume[76226]: WARNING amqp [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 22:12:23 devstack cinder-volume[76064]: INFO oslo_service.backend._eventlet.service [None req-91be806f-c26c-4fd1-9490-9f9806dc6690 None None] Child 76226 exited with status 0 Nov 05 22:12:23 devstack cinder-volume[86293]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 22:12:23 devstack cinder-volume[86293]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 22:12:23 devstack cinder-volume[86293]: we strongly recommend against using it for new projects. Nov 05 22:12:23 devstack cinder-volume[86293]: If you are already using Eventlet, we recommend migrating to a different Nov 05 22:12:23 devstack cinder-volume[86293]: framework. For more detail see Nov 05 22:12:23 devstack cinder-volume[86293]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 22:12:23 devstack cinder-volume[86293]: import eventlet # noqa Nov 05 22:12:25 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:12:25 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:12:25 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:12:26 devstack cinder-volume[86293]: INFO dbcounter [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Registered counter for database cinder Nov 05 22:12:26 devstack cinder-volume[86293]: DEBUG oslo_db.sqlalchemy.engines [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86293) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:12:26 devstack cinder-volume[86293]: DEBUG dbcounter [-] [86293] Writer thread running {{(pid=86293) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:12:26 devstack cinder-volume[86293]: INFO cinder.rpc [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 22:12:26 devstack cinder-volume[86293]: INFO cinder.rpc [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 22:12:26 devstack cinder-volume[86293]: DEBUG oslo_db.sqlalchemy.engines [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86293) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:12:26 devstack cinder-volume[86293]: INFO cinder.volume.manager [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Determined volume DB was empty at startup. Nov 05 22:12:26 devstack cinder-volume[86293]: DEBUG cinder.volume.manager [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86293) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 22:12:26 devstack cinder-volume[86293]: INFO cinder.volume.manager [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 22:12:26 devstack cinder-volume[86293]: WARNING stevedore.named [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 22:12:26 devstack cinder-volume[86293]: WARNING castellan.key_manager [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:12:26 devstack cinder-volume[86293]: WARNING cinder.keymgr.conf_key_mgr [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:12:27 devstack cinder-volume[86293]: INFO cinder.volume.manager [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_db.sqlalchemy.engines [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86293) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:12:27 devstack cinder-volume[86293]: INFO oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Starting 1 workers Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Started child 86505 {{(pid=86293) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Full set of CONF: {{(pid=86293) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] ******************************************************************************** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Configuration options gathered from: {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] ================================================================================ {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] allow_availability_zone_fallback = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] allow_compression_on_image_upload = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] allowed_direct_url_schemes = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] api_rate_limit = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86505]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] auth_strategy = keystone {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_availability_zone = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_host = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_stats_polling_interval = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backup_api_class = cinder.backup.api.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backup_name_template = backup-%s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backup_use_same_host = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backup_use_temp_snapshot = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] chap_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] chap_username = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cinder_internal_tenant_project_id = 5c8f02e4139046a98a6c223da316509c {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cinder_internal_tenant_user_id = 4fd31888469a4c01a4d66abc32994f21 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cluster = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] compression_format = gzip {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] compute_api_class = cinder.compute.nova.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] config_dir = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] config_source = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] control_exchange = openstack {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] debug = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] default_availability_zone = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] default_group_type = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] default_volume_type = QuobyteHD {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] disk_geometry = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] driver_client_cert = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] driver_client_cert_key = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] driver_data_namespace = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] driver_ssl_cert_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] driver_ssl_cert_verify = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] driver_use_ssl = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] enable_new_services = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] enable_unsupported_driver = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] enabled_backends = ['QuobyteHD'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] enforce_multipath_for_image_xfer = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] filter_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance_api_insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance_api_servers = ['http://192.168.122.30/image'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance_api_ssl_compression = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance_ca_certificates_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance_catalog_info = image:glance:publicURL {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance_certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance_keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance_num_retries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance_request_timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] goodness_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] graceful_shutdown_timeout = 5 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] group_api_class = cinder.group.api.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] host = devstack {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_compress_on_upload = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_conversion_address_space_limit = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_conversion_cpu_limit = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_conversion_disable = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_introspection_address_space_limit = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_introspection_cpu_limit = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_upload_use_cinder_backend = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_upload_use_internal_tenant = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_volume_cache_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_volume_cache_max_count = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] image_volume_cache_max_size_gb = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] init_host_max_objects_retrieval = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] instance_format = [instance: %(uuid)s] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] iscsi_target_flags = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] iscsi_write_cache = on {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] iser_helper = tgtadm {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] iser_ip_address = 192.168.122.30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] iser_port = 3260 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] log_color = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] log_config_append = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] log_dir = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] log_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] log_options = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] log_rotate_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] log_rotate_interval_type = days {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] log_rotation_type = none {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] max_age = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] max_logfile_count = 30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] max_logfile_size_mb = 200 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] max_over_subscription_ratio = 20.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] message_reap_interval = 86400 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] message_ttl = 2592000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] migration_create_volume_timeout_secs = 300 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] monkey_patch = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] monkey_patch_modules = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] my_ip = 192.168.122.30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] no_snapshot_gb_quota = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] num_iser_scan_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] num_shell_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] num_volume_device_scan_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] nvmeof_conn_info_version = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] nvmet_ns_id = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] nvmet_port_id = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] osapi_max_limit = 1000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] osapi_volume_ext_list = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] osapi_volume_listen_port = 8776 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] osapi_volume_use_ssl = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] osapi_volume_workers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] per_volume_size_limit = -1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] periodic_fuzzy_delay = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] periodic_interval = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] public_endpoint = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] publish_errors = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] quota_backup_gigabytes = 1000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] quota_backups = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] quota_gigabytes = 1000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] quota_groups = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] quota_snapshots = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] quota_volumes = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] rate_limit_burst = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] rate_limit_except_level = CRITICAL {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] rate_limit_interval = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] reinit_driver_count = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] replication_device = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] report_discard_supported = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] report_interval = 120 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] reservation_clean_interval = 86400 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] reservation_expire = 86400 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] reserved_image_namespaces = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] reserved_percentage = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] rpc_response_timeout = 120 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] run_external_periodic_tasks = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] scst_target_driver = iscsi {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] scst_target_iqn_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_down_time = 720 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] shell_completion = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] snapshot_name_template = snapshot-%s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] split_loggers = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] state_path = /opt/stack/data/cinder {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] storage_availability_zone = nova {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] storage_protocol = iSCSI {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] syslog_log_facility = LOG_USER {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] target_helper = lioadm {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] target_ip_address = 192.168.122.30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] target_port = 3260 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] target_protocol = iscsi {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] target_secondary_ip_addresses = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] trace_flags = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] transport_url = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] until_refresh = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] use_chap_auth = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] use_default_quota_class = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] use_journal = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] use_json = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] use_multipath_for_image_xfer = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] use_stderr = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] use_syslog = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] verify_glance_signatures = enabled {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_api_class = cinder.volume.api.API {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_backend_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_clear = zero {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_clear_ionice = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_clear_size = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_copy_bps_limit = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_dd_blocksize = 1M {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_name_template = volume-%s {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_service_inithost_offload = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volume_usage_audit_period = month {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] zoning_mode = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_concurrency.disable_process_locking = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.auth_section = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.auth_type = password {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.auth_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.cache = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86505]: INFO cinder.volume.manager [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 22:12:27 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.remotefs [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86505) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.include_service_catalog = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.interface = public {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcache_username = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.region_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.service_type = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.30/identity {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.backend = dogpile.cache.null {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.backend_argument = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.backend_expiration_time = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.config_prefix = cache.oslo {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.debug_cache_backend = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.enable_retry_client = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.enable_socket_keepalive = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.expiration_time = 600 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.hashclient_retry_attempts = 2 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.memcache_dead_retry = 300 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.memcache_pool_maxsize = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.memcache_sasl_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.proxies = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.redis_db = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.redis_server = localhost:6379 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.retry_attempts = 2 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.retry_delay = 0.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.socket_keepalive_count = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.socket_keepalive_idle = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.socket_keepalive_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.socket_timeout = 1.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.tls_allowed_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.tls_cafile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.tls_certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.tls_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.tls_keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cache.username = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] coordination.backend_url = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.asyncio_connection = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.asyncio_slave_connection = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.backend = sqlalchemy {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.connection = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.connection_debug = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.connection_parameters = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.connection_recycle_time = 3600 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.connection_trace = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.db_inc_retry_interval = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.db_max_retries = 20 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.db_max_retry_interval = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.db_retry_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.max_overflow = 50 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.max_pool_size = 5 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.max_retries = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.mysql_wsrep_sync_wait = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.pool_timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.retry_interval = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.slave_connection = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.sqlite_synchronous = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.synchronous_reader = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] database.use_db_reconnect = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_tracing.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.connection_string = messaging:// {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.es_doc_type = notification {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.es_scroll_size = 10000 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.es_scroll_time = 2m {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.filter_error_trace = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.hmac_keys = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.sentinel_service_name = mymaster {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.socket_timeout = 0.1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.trace_requests = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler.trace_sqlalchemy = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler_jaeger.process_tags = {} {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler_jaeger.service_name_prefix = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] profiler_otlp.service_name_prefix = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_policy.enforce_new_defaults = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_policy.policy_default_rule = default {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_policy.policy_file = policy.yaml {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] privsep_osbrick.group = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] privsep_osbrick.helper_command = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] privsep_osbrick.user = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cinder_sys_admin.group = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cinder_sys_admin.helper_command = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] cinder_sys_admin.user = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.auth_section = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.auth_type = password {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.cafile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.collect_timing = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.send_service_user_token = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.split_loggers = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.tls_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] service_user.tls_min_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.auth_section = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.auth_type = password {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.collect_timing = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.region_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.split_loggers = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.tls_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] glance.tls_min_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.backend_availability_zone = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.chap_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.chap_username = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.disk_geometry = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.driver_client_cert = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.driver_client_cert_key = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.driver_data_namespace = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.driver_use_ssl = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.extra_capabilities = {} {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.filter_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.goodness_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.iscsi_target_flags = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.iscsi_write_cache = on {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.iser_helper = tgtadm {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.iser_ip_address = 192.168.122.30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.iser_port = 3260 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nas_host = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nas_login = admin {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nas_mount_options = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nas_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nas_private_key = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nas_share_path = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.num_shell_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.quobyte_volume_url = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.replication_device = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.report_discard_supported = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.reserved_percentage = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.target_helper = tgtadm {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.target_ip_address = 192.168.122.30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.target_port = 3260 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.target_protocol = iscsi {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.trace_flags = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.unique_fqdn_network = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.use_chap_auth = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.volume_backend_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.volume_clear = zero {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.volume_clear_ionice = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.volume_clear_size = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_reports.file_event_handler = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_reports.log_dir = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86505) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 22:12:27 devstack cinder-volume[86505]: WARNING cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 22:12:27 devstack cinder-volume[86505]: WARNING cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.backend_availability_zone = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.backend_host = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.chap_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.chap_username = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.chiscsi_conf = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.disk_geometry = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.driver_client_cert = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.driver_data_namespace = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.driver_use_ssl = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.extra_capabilities = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.filter_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Running cmd (subprocess): mount.quobyte {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.goodness_function = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.iser_helper = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.iser_ip_address = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.iser_port = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.iser_target_prefix = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nas_host = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nas_login = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nas_mount_options = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nas_password = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nas_private_key = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nas_share_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nas_ssh_port = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.num_shell_tries = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.nvmet_port_id = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.replication_device = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.report_discard_supported = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.reserved_percentage = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.scst_target_driver = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.storage_protocol = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.target_helper = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.target_ip_address = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.target_port = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.target_prefix = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.target_protocol = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.trace_flags = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.use_chap_auth = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.volume_clear = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.volume_clear_size = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] QuobyteHD.volumes_dir = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.ssl = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_notifications.driver = [] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_notifications.retry = -1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] key_manager.fixed_key = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.barbican_api_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.barbican_endpoint = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.barbican_endpoint_type = public {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.barbican_region_name = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.cafile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.collect_timing = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.number_of_retries = 60 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.retry_delay = 1 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.send_service_user_token = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.split_loggers = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.tls_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.tls_min_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.verify_ssl = True {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican.verify_ssl_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.auth_section = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.auth_type = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.cafile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.certfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.collect_timing = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.insecure = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.keyfile = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.split_loggers = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.timeout = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.tls_ciphers = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] barbican_service_user.tls_min_version = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.approle_role_id = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.approle_secret_id = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.auth_method = approle {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.auth_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.kv_mountpoint = secret {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.kv_path = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.kv_version = 2 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.namespace = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.root_token_id = **** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.ssl_ca_crt_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.timeout = 60.0 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.token_file = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.token_role = None {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.use_ssl = False {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:27 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] ******************************************************************************** {{(pid=86293) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 22:12:27 devstack quobyte-client[86514]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 22:12:27 devstack quobyte-client[86514]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 22:12:27 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:27 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:12:27 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:12:27 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=86505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:12:27 devstack cinder-volume[86505]: INFO cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 ... Nov 05 22:12:27 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa -c /etc/quobyte/client-cinder.cfg {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:27 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa -c /etc/quobyte/client-cinder.cfg Nov 05 22:12:27 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:28 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.459s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:28 devstack cinder-volume[86505]: INFO cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 succeeded Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=86505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.473s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:28 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:12:28 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:28 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.247s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:28 devstack cinder-volume[86505]: INFO cinder.volume.driver [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Driver hasn't implemented _init_vendor_properties() Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.volume.driver [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.367332458496, 'free_capacity_gb': 1773.367332458496, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86505) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_db.sqlalchemy.engines [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86505) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG dbcounter [-] [86505] Writer thread running {{(pid=86505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.db.api [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Building query based on filter {{(pid=86505) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.image.image_utils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86505) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 22:12:28 devstack cinder-volume[86505]: INFO cinder.keymgr.migration [None req-40c1670b-2d10-4239-b4bb-f6fadf7d5f74 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=86505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=86505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:28 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:12:28 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:28 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.231s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.manager [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Notifying Schedulers of capabilities ... {{(pid=86505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:12:28 devstack cinder-volume[86505]: INFO cinder.volume.manager [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Driver initialization completed successfully. Nov 05 22:12:28 devstack cinder-volume[86505]: INFO cinder.manager [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Initiating service 3 cleanup Nov 05 22:12:28 devstack cinder-volume[86505]: INFO cinder.manager [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Service 3 cleanup completed. Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.service [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Creating RPC server for service cinder-volume {{(pid=86505) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.service [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86505) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 22:12:28 devstack cinder-volume[86505]: INFO cinder.volume.manager [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=86505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=86505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:12:28 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:28 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:12:28 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:29 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:29 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.284s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:29 devstack cinder-volume[86505]: INFO cinder.volume.manager [None req-5227d82d-da55-4575-a37c-6b6268357aad None None] Driver post RPC initialization completed successfully. Nov 05 22:12:33 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-d7afcfb8-e463-45eb-a3bc-cdaa307214eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:12:33 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-d7afcfb8-e463-45eb-a3bc-cdaa307214eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:12:33 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-d7afcfb8-e463-45eb-a3bc-cdaa307214eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=86505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:12:33 devstack cinder-volume[86505]: DEBUG cinder.volume.drivers.quobyte [None req-d7afcfb8-e463-45eb-a3bc-cdaa307214eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=86505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:12:33 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-d7afcfb8-e463-45eb-a3bc-cdaa307214eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:12:33 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-d7afcfb8-e463-45eb-a3bc-cdaa307214eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:33 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:12:33 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:33 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:33 devstack cinder-volume[86505]: DEBUG oslo_concurrency.processutils [None req-d7afcfb8-e463-45eb-a3bc-cdaa307214eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.255s {{(pid=86505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:33 devstack cinder-volume[86505]: DEBUG cinder.manager [None req-d7afcfb8-e463-45eb-a3bc-cdaa307214eb None None] Notifying Schedulers of capabilities ... {{(pid=86505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:12:34 devstack cinder-volume[86293]: INFO oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Caught SIGTERM, stopping children Nov 05 22:12:34 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Acquiring lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:12:34 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Acquired lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:12:34 devstack cinder-volume[86293]: DEBUG oslo_concurrency.lockutils [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Releasing lock "singleton_lock" {{(pid=86293) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:12:34 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Stop services. {{(pid=86293) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 22:12:34 devstack cinder-volume[86293]: DEBUG oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Killing children. {{(pid=86293) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 22:12:34 devstack cinder-volume[86293]: INFO oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Waiting on 1 children to exit Nov 05 22:12:37 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Acquiring lock "singleton_lock" {{(pid=86505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:12:37 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Acquired lock "singleton_lock" {{(pid=86505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:12:37 devstack cinder-volume[86505]: DEBUG oslo_concurrency.lockutils [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Releasing lock "singleton_lock" {{(pid=86505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:12:37 devstack cinder-volume[86505]: WARNING amqp [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 22:12:37 devstack cinder-volume[86505]: WARNING amqp [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 22:12:37 devstack cinder-volume[86293]: INFO oslo_service.backend._eventlet.service [None req-1cbcb6aa-d984-49bd-8b5e-d271e84c7e60 None None] Child 86505 exited with status 0 Nov 05 22:12:37 devstack cinder-volume[86828]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 22:12:37 devstack cinder-volume[86828]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 22:12:37 devstack cinder-volume[86828]: we strongly recommend against using it for new projects. Nov 05 22:12:37 devstack cinder-volume[86828]: If you are already using Eventlet, we recommend migrating to a different Nov 05 22:12:37 devstack cinder-volume[86828]: framework. For more detail see Nov 05 22:12:37 devstack cinder-volume[86828]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 22:12:37 devstack cinder-volume[86828]: import eventlet # noqa Nov 05 22:12:40 devstack cinder-volume[86828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:12:40 devstack cinder-volume[86828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:12:40 devstack cinder-volume[86828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:12:41 devstack cinder-volume[86828]: INFO dbcounter [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Registered counter for database cinder Nov 05 22:12:41 devstack cinder-volume[86828]: DEBUG oslo_db.sqlalchemy.engines [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86828) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:12:41 devstack cinder-volume[86828]: DEBUG dbcounter [-] [86828] Writer thread running {{(pid=86828) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:12:41 devstack cinder-volume[86828]: INFO cinder.rpc [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 22:12:41 devstack cinder-volume[86828]: INFO cinder.rpc [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_db.sqlalchemy.engines [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86828) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:12:42 devstack cinder-volume[86828]: INFO cinder.volume.manager [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Determined volume DB was empty at startup. Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG cinder.volume.manager [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86828) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 22:12:42 devstack cinder-volume[86828]: WARNING stevedore.named [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 22:12:42 devstack cinder-volume[86828]: WARNING castellan.key_manager [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:12:42 devstack cinder-volume[86828]: WARNING cinder.keymgr.conf_key_mgr [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:12:42 devstack cinder-volume[86828]: INFO cinder.volume.manager [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_db.sqlalchemy.engines [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86828) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:12:42 devstack cinder-volume[86828]: INFO oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Starting 1 workers Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Started child 87122 {{(pid=86828) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Full set of CONF: {{(pid=86828) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] ******************************************************************************** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] Configuration options gathered from: {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] ================================================================================ {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] allow_availability_zone_fallback = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] allow_compression_on_image_upload = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] allowed_direct_url_schemes = [] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] api_rate_limit = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] auth_strategy = keystone {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_availability_zone = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_host = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_name = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_stats_polling_interval = 60 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backup_api_class = cinder.backup.api.API {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backup_name_template = backup-%s {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backup_use_same_host = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backup_use_temp_snapshot = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] chap_password = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] chap_username = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cinder_internal_tenant_project_id = 5c8f02e4139046a98a6c223da316509c {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cinder_internal_tenant_user_id = 4fd31888469a4c01a4d66abc32994f21 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cluster = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] compression_format = gzip {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] compute_api_class = cinder.compute.nova.API {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] config_dir = [] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] config_source = [] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] control_exchange = openstack {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] debug = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] default_availability_zone = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] default_group_type = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] default_volume_type = QuobyteHD {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] disk_geometry = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] driver_client_cert = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[87122]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] driver_client_cert_key = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] driver_data_namespace = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] driver_ssl_cert_path = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] driver_ssl_cert_verify = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] driver_use_ssl = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] enable_new_services = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] enable_unsupported_driver = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] enabled_backends = ['QuobyteHD'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] enforce_multipath_for_image_xfer = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] filter_function = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance_api_insecure = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance_api_servers = ['http://192.168.122.30/image'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance_api_ssl_compression = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance_ca_certificates_file = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance_catalog_info = image:glance:publicURL {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance_certfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance_keyfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance_num_retries = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance_request_timeout = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] goodness_function = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] graceful_shutdown_timeout = 5 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] group_api_class = cinder.group.api.API {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] host = devstack {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_compress_on_upload = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_conversion_address_space_limit = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_conversion_cpu_limit = 60 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_conversion_disable = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_introspection_address_space_limit = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_introspection_cpu_limit = 60 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_upload_use_cinder_backend = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_upload_use_internal_tenant = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_volume_cache_enabled = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_volume_cache_max_count = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] image_volume_cache_max_size_gb = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] init_host_max_objects_retrieval = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] instance_format = [instance: %(uuid)s] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] iscsi_target_flags = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] iscsi_write_cache = on {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] iser_helper = tgtadm {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] iser_ip_address = 192.168.122.30 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] iser_port = 3260 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] log_color = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] log_config_append = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] log_dir = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] log_file = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] log_options = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] log_rotate_interval = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] log_rotate_interval_type = days {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] log_rotation_type = none {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] max_age = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] max_logfile_count = 30 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] max_logfile_size_mb = 200 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] max_over_subscription_ratio = 20.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] message_reap_interval = 86400 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] message_ttl = 2592000 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] migration_create_volume_timeout_secs = 300 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] monkey_patch = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] monkey_patch_modules = [] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] my_ip = 192.168.122.30 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] no_snapshot_gb_quota = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] num_iser_scan_tries = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] num_shell_tries = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] num_volume_device_scan_tries = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] nvmeof_conn_info_version = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] nvmet_ns_id = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] nvmet_port_id = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] osapi_max_limit = 1000 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] osapi_volume_ext_list = [] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] osapi_volume_listen_port = 8776 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] osapi_volume_use_ssl = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] osapi_volume_workers = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] per_volume_size_limit = -1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] periodic_fuzzy_delay = 60 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] periodic_interval = 60 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] public_endpoint = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] publish_errors = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] quota_backup_gigabytes = 1000 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] quota_backups = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] quota_gigabytes = 1000 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] quota_groups = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] quota_snapshots = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] quota_volumes = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] rate_limit_burst = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] rate_limit_except_level = CRITICAL {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] rate_limit_interval = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] reinit_driver_count = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] replication_device = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] report_discard_supported = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] report_interval = 120 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] reservation_clean_interval = 86400 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] reservation_expire = 86400 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] reserved_image_namespaces = [] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] reserved_percentage = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] rpc_response_timeout = 120 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] run_external_periodic_tasks = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] scst_target_driver = iscsi {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] scst_target_iqn_name = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_down_time = 720 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] shell_completion = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] snapshot_name_template = snapshot-%s {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] split_loggers = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] state_path = /opt/stack/data/cinder {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] storage_availability_zone = nova {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] storage_protocol = iSCSI {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] syslog_log_facility = LOG_USER {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] target_helper = lioadm {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] target_ip_address = 192.168.122.30 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] target_port = 3260 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] target_protocol = iscsi {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] target_secondary_ip_addresses = [] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] trace_flags = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] transport_url = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] until_refresh = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] use_chap_auth = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] use_default_quota_class = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] use_journal = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] use_json = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] use_multipath_for_image_xfer = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] use_stderr = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] use_syslog = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] verify_glance_signatures = enabled {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_api_class = cinder.volume.api.API {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_backend_name = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_clear = zero {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_clear_ionice = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_clear_size = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_copy_bps_limit = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87122) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_dd_blocksize = 1M {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_name_template = volume-%s {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_service_inithost_offload = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volume_usage_audit_period = month {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] zoning_mode = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_concurrency.disable_process_locking = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.auth_section = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.auth_type = password {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.auth_version = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.cache = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.certfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.include_service_catalog = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.insecure = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.interface = public {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.keyfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_password = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcache_username = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.region_name = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.service_type = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.30/identity {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.backend = dogpile.cache.null {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.backend_argument = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.backend_expiration_time = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.config_prefix = cache.oslo {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.debug_cache_backend = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.enable_retry_client = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.enable_socket_keepalive = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.enabled = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.expiration_time = 600 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.hashclient_retry_attempts = 2 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.memcache_dead_retry = 300 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.memcache_pool_maxsize = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.memcache_sasl_enabled = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.password = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.proxies = [] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.redis_db = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.redis_server = localhost:6379 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.retry_attempts = 2 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.retry_delay = 0.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.socket_keepalive_count = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.socket_keepalive_idle = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.socket_keepalive_interval = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.socket_timeout = 1.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.tls_allowed_ciphers = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.tls_cafile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.tls_certfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.tls_enabled = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.tls_keyfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cache.username = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] coordination.backend_url = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.asyncio_connection = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.asyncio_slave_connection = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.backend = sqlalchemy {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.connection = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.connection_debug = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.connection_parameters = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.connection_recycle_time = 3600 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.connection_trace = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.db_inc_retry_interval = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.db_max_retries = 20 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.db_max_retry_interval = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.db_retry_interval = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.max_overflow = 50 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.max_pool_size = 5 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.max_retries = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.mysql_wsrep_sync_wait = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.pool_timeout = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.retry_interval = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.slave_connection = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.sqlite_synchronous = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.synchronous_reader = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] database.use_db_reconnect = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_tracing.insecure = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.connection_string = messaging:// {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.enabled = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.es_doc_type = notification {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.es_scroll_size = 10000 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.es_scroll_time = 2m {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.filter_error_trace = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.hmac_keys = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.sentinel_service_name = mymaster {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.socket_timeout = 0.1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.trace_requests = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler.trace_sqlalchemy = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler_jaeger.process_tags = {} {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler_jaeger.service_name_prefix = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] profiler_otlp.service_name_prefix = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_policy.enforce_new_defaults = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_policy.policy_default_rule = default {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_policy.policy_file = policy.yaml {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] privsep_osbrick.group = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] privsep_osbrick.helper_command = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] privsep_osbrick.user = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cinder_sys_admin.group = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cinder_sys_admin.helper_command = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] cinder_sys_admin.user = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.auth_section = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.auth_type = password {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.cafile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.certfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.collect_timing = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.insecure = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.keyfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.send_service_user_token = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.split_loggers = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.timeout = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.tls_ciphers = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] service_user.tls_min_version = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.auth_section = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.auth_type = password {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.certfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.collect_timing = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.insecure = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.keyfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.region_name = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.split_loggers = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.timeout = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.tls_ciphers = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] glance.tls_min_version = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.backend_availability_zone = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.chap_password = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.chap_username = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.disk_geometry = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.driver_client_cert = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.driver_client_cert_key = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.driver_data_namespace = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.driver_use_ssl = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.extra_capabilities = {} {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.filter_function = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.goodness_function = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.iscsi_target_flags = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.iscsi_write_cache = on {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.iser_helper = tgtadm {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.iser_ip_address = 192.168.122.30 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.iser_port = 3260 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nas_host = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nas_login = admin {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nas_mount_options = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nas_password = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nas_private_key = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nas_share_path = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.num_shell_tries = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.quobyte_volume_url = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.replication_device = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.report_discard_supported = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.reserved_percentage = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.target_helper = tgtadm {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.target_ip_address = 192.168.122.30 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.target_port = 3260 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.target_protocol = iscsi {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.trace_flags = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.unique_fqdn_network = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.use_chap_auth = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.volume_backend_name = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.volume_clear = zero {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.volume_clear_ionice = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.volume_clear_size = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_reports.file_event_handler = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_reports.log_dir = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.backend_availability_zone = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.backend_host = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.chap_password = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.chap_username = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.chiscsi_conf = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.disk_geometry = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.driver_client_cert = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.driver_data_namespace = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.driver_use_ssl = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.extra_capabilities = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.filter_function = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.goodness_function = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.iser_helper = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.iser_ip_address = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.iser_port = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.iser_target_prefix = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nas_host = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nas_login = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nas_mount_options = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nas_password = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nas_private_key = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nas_share_path = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nas_ssh_port = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.num_shell_tries = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.nvmet_port_id = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.replication_device = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.report_discard_supported = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.reserved_percentage = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.scst_target_driver = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.storage_protocol = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.target_helper = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.target_ip_address = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.target_port = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.target_prefix = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.target_protocol = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.trace_flags = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.use_chap_auth = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.volume_clear = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.volume_clear_size = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] QuobyteHD.volumes_dir = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.ssl = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_notifications.driver = [] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_notifications.retry = -1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] key_manager.fixed_key = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.barbican_api_version = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.barbican_endpoint = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.barbican_endpoint_type = public {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.barbican_region_name = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.cafile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.certfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.collect_timing = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.insecure = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.keyfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.number_of_retries = 60 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.retry_delay = 1 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.send_service_user_token = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.split_loggers = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.timeout = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.tls_ciphers = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.tls_min_version = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87122) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 22:12:42 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.quobyte [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.verify_ssl = True {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.quobyte [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican.verify_ssl_path = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.auth_section = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.auth_type = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.cafile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.certfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.collect_timing = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.insecure = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.keyfile = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.split_loggers = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.timeout = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.tls_ciphers = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] barbican_service_user.tls_min_version = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.approle_role_id = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Running cmd (subprocess): mount.quobyte {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.approle_secret_id = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.auth_method = approle {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.auth_path = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.kv_mountpoint = secret {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.kv_path = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.kv_version = 2 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.namespace = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.root_token_id = **** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.ssl_ca_crt_file = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.timeout = 60.0 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.token_file = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.token_role = None {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.use_ssl = False {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:12:42 devstack cinder-volume[86828]: DEBUG oslo_service.backend._eventlet.service [None req-2ebf65cb-bbe9-49a3-81a5-aa64dcd32c88 None None] ******************************************************************************** {{(pid=86828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 22:12:42 devstack quobyte-client[87123]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 22:12:42 devstack quobyte-client[87123]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:42 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:12:42 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:42 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.233s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:42 devstack cinder-volume[87122]: INFO cinder.volume.driver [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG cinder.volume.driver [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.367332458496, 'free_capacity_gb': 1773.367332458496, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87122) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_db.sqlalchemy.engines [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87122) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writer thread running {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG cinder.db.api [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Building query based on filter {{(pid=87122) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87122) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:12:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:42 devstack cinder-volume[87122]: INFO cinder.keymgr.migration [None req-7fc184ad-e6ee-4ef3-87bc-bab982cdcf2e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 22:12:42 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:12:42 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:43 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.229s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:12:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Driver initialization completed successfully. Nov 05 22:12:43 devstack cinder-volume[87122]: INFO cinder.manager [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Initiating service 3 cleanup Nov 05 22:12:43 devstack cinder-volume[87122]: INFO cinder.manager [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Service 3 cleanup completed. Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG cinder.service [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Creating RPC server for service cinder-volume {{(pid=87122) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG cinder.service [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87122) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 22:12:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:43 devstack sudo[87150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:12:43 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:43 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0d130140-ae5c-4caa-83bc-a363b2710af6 None None] Driver post RPC initialization completed successfully. Nov 05 22:12:52 devstack cinder-volume[86828]: DEBUG dbcounter [-] [86828] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86828) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:12:53 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:12:53 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:12:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:12:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 6 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:12:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Flow 'volume_create_manager' (c1ae128b-142c-473c-a7ce-cf02e38813c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a94ce2-350a-47e4-9f4e-8aeb372fdd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a94ce2-350a-47e4-9f4e-8aeb372fdd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-917355017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71bb055-75a2-4390-b29b-69dc01d938ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5130301e4e744c01acd5ee3f40f46017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:13:41Z,use_quota=True,user_id='886b32591f194a4db7a610bd9c73f304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb6dba3-745c-42f7-ad78-3f201ba63267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb6dba3-745c-42f7-ad78-3f201ba63267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb4b94d-c669-47bf-a157-c6b3486caade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb4b94d-c669-47bf-a157-c6b3486caade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71bb055-75a2-4390-b29b-69dc01d938ca', 'volume_name': 'volume-c71bb055-75a2-4390-b29b-69dc01d938ca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfc888c-27e0-4e0f-90fb-fbdc71154f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfc888c-27e0-4e0f-90fb-fbdc71154f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e9aed7-19ca-4f99-ab40-7c5fcd81b476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:13:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Volume c71bb055-75a2-4390-b29b-69dc01d938ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71bb055-75a2-4390-b29b-69dc01d938ca', 'volume_size': 1} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-917355017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71bb055-75a2-4390-b29b-69dc01d938ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5130301e4e744c01acd5ee3f40f46017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:13:41Z,use_quota=True,user_id='886b32591f194a4db7a610bd9c73f304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Creating volume c71bb055-75a2-4390-b29b-69dc01d938ca {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:13:41 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:13:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:41 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca 1073741824 Nov 05 22:13:41 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:42 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca 1073741824" returned: 0 in 0.633s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:42 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca Nov 05 22:13:42 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:42 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca" returned: 0 in 0.246s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:13:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:13:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e9aed7-19ca-4f99-ab40-7c5fcd81b476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71bb055-75a2-4390-b29b-69dc01d938ca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:13:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513391c8-12b0-4af7-8cf1-5bb2a59e14be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:13:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Volume volume-c71bb055-75a2-4390-b29b-69dc01d938ca (c71bb055-75a2-4390-b29b-69dc01d938ca): created successfully Nov 05 22:13:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513391c8-12b0-4af7-8cf1-5bb2a59e14be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:13:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Flow 'volume_create_manager' (c1ae128b-142c-473c-a7ce-cf02e38813c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:13:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ab7606c1-22e0-4ae7-a0b3-28bd0af7f2a2 tempest-TaggedAttachmentsTest-515339989 None] Created volume successfully. Nov 05 22:13:52 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:13:52 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:13:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:13:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:13:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:57 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:13:57 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:58 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.666s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:13:58 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 6 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:13:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Flow 'volume_create_manager' (ec95935b-56bf-42e4-b29e-55cbfc87546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61263363-3de9-46e4-b590-8114f12a2175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61263363-3de9-46e4-b590-8114f12a2175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2142037080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c00aba-7178-4a63-9ddc-26228b85bf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9329870aab4e929d08166f43e5c31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:14:14Z,use_quota=True,user_id='9c082e60644c4c1bbf5a71c463686155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7faa8fd7-45b1-49bf-a287-3ffb4675cfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7faa8fd7-45b1-49bf-a287-3ffb4675cfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa8596f-08af-4065-851f-886d3cbe2413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa8596f-08af-4065-851f-886d3cbe2413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0c00aba-7178-4a63-9ddc-26228b85bf42', 'volume_name': 'volume-f0c00aba-7178-4a63-9ddc-26228b85bf42', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a070411-8c4e-47f7-b87e-0983d4fd028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a070411-8c4e-47f7-b87e-0983d4fd028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e45a089-668b-47ce-ac9c-e5ac78b4c322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Volume f0c00aba-7178-4a63-9ddc-26228b85bf42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0c00aba-7178-4a63-9ddc-26228b85bf42', 'volume_size': 1} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2142037080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c00aba-7178-4a63-9ddc-26228b85bf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9329870aab4e929d08166f43e5c31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:14:14Z,use_quota=True,user_id='9c082e60644c4c1bbf5a71c463686155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Creating volume f0c00aba-7178-4a63-9ddc-26228b85bf42 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:14:14 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:14:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:14 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42 1073741824 Nov 05 22:14:14 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:15 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42 1073741824" returned: 0 in 1.114s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:15 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42 Nov 05 22:14:15 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:16 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42" returned: 0 in 0.521s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:14:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e45a089-668b-47ce-ac9c-e5ac78b4c322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c00aba-7178-4a63-9ddc-26228b85bf42', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8759bfae-02a8-4831-85ee-c628ebf4d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Volume volume-f0c00aba-7178-4a63-9ddc-26228b85bf42 (f0c00aba-7178-4a63-9ddc-26228b85bf42): created successfully Nov 05 22:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8759bfae-02a8-4831-85ee-c628ebf4d73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Flow 'volume_create_manager' (ec95935b-56bf-42e4-b29e-55cbfc87546b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:14:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-77010ec0-5053-4dcb-84cd-ec13c610e67a tempest-VolumesAdminNegativeTest-854405384 None] Created volume successfully. Nov 05 22:14:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Acquiring lock "cinder-f0c00aba-7178-4a63-9ddc-26228b85bf42-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:14:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Lock "cinder-f0c00aba-7178-4a63-9ddc-26228b85bf42-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:14:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Acquiring lock "cinder-quobyte-f0c00aba-7178-4a63-9ddc-26228b85bf42" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:14:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Lock "cinder-quobyte-f0c00aba-7178-4a63-9ddc-26228b85bf42" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:14:19 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1kixj5fz/privsep.sock'] Nov 05 22:14:19 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1kixj5fz/privsep.sock Nov 05 22:14:19 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:21 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 22:14:21 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 22:14:21 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 22:14:21 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 22:14:21 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 22:14:21 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 22:14:21 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 22:14:21 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 22:14:21 devstack cinder-volume[87122]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 22:14:22 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:22 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Spawned new privsep daemon via rootwrap Nov 05 22:14:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Accepted privsep connection to /tmp/tmp1kixj5fz/privsep.sock {{(pid=87122) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 22:14:22 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 22:14:22 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 22:14:22 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 22:14:22 devstack cinder-volume[87122]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88382 Nov 05 22:14:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fb944a-9d58-4522-b09a-0ee72db5a7d7]: (2,) {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:14:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7482f306-c5d3-4d30-be92-ae03bcc3a1d5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:22 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42 Nov 05 22:14:22 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:22 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42" returned: 0 in 0.613s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:22 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42 Nov 05 22:14:22 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:23 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0c00aba-7178-4a63-9ddc-26228b85bf42" returned: 0 in 0.820s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Lock "cinder-quobyte-f0c00aba-7178-4a63-9ddc-26228b85bf42" released by "delete_volume" :: held 4.322s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:14:23 devstack cinder-volume[87122]: WARNING cinder.quota [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:14:23 devstack cinder-volume[87122]: WARNING cinder.quota [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:14:24 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Created reservations ['20dcf4cc-b522-4195-a641-5b771b4a5778', 'fe2dde85-422d-4fd6-87f9-34d1b0325c8d', 'd4d76e01-0646-47a6-9e95-efb47d265332', '04cd314e-3b06-43d4-8268-656741888aba'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:14:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:14:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:14:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:24 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:14:24 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:24 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.607s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:24 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:14:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Deleted volume successfully. Nov 05 22:14:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9bc6ba99-7c6a-48c6-aa5d-9e9763dc6886 tempest-VolumesAdminNegativeTest-854405384 None] Lock "cinder-f0c00aba-7178-4a63-9ddc-26228b85bf42-delete_volume" released by "delete_volume" :: held 5.657s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Flow 'volume_create_manager' (c5b3a869-abd0-49e8-bb45-69d0710e6781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b0c74f-1aae-4250-ab56-c77b13ecf404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b0c74f-1aae-4250-ab56-c77b13ecf404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-892070574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9d6edf-d5c5-4cb9-ad88-7323833bee22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9152da3556469c85e5bd93d80a1bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:14:30Z,use_quota=True,user_id='1ac308355f10443f872393f946c5fe07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92443419-487a-4a7d-8269-cd482a40efb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92443419-487a-4a7d-8269-cd482a40efb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c139151-2370-49f6-8119-0e102c7004a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c139151-2370-49f6-8119-0e102c7004a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9d6edf-d5c5-4cb9-ad88-7323833bee22', 'volume_name': 'volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ea6217-b9e6-40e3-af7c-31d9b79ed5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ea6217-b9e6-40e3-af7c-31d9b79ed5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10c1a60-6261-4996-98cd-c105fdc77471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Volume ea9d6edf-d5c5-4cb9-ad88-7323833bee22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22', 'volume_size': 1} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-892070574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9d6edf-d5c5-4cb9-ad88-7323833bee22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9152da3556469c85e5bd93d80a1bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:14:30Z,use_quota=True,user_id='1ac308355f10443f872393f946c5fe07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Creating volume ea9d6edf-d5c5-4cb9-ad88-7323833bee22 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:14:30 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:14:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:30 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22 1073741824 Nov 05 22:14:30 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:31 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22 1073741824" returned: 0 in 0.834s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:31 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22 Nov 05 22:14:31 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:31 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:14:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10c1a60-6261-4996-98cd-c105fdc77471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9db9b32-50db-4cf7-814f-64e15155cd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Volume volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22 (ea9d6edf-d5c5-4cb9-ad88-7323833bee22): created successfully Nov 05 22:14:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9db9b32-50db-4cf7-814f-64e15155cd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Flow 'volume_create_manager' (c5b3a869-abd0-49e8-bb45-69d0710e6781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:14:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5ad368fb-0196-485c-b6d2-fe7ba9d6db23 tempest-ServersNegativeTestJSON-2006314062 None] Created volume successfully. Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Flow 'volume_create_manager' (236dfc24-cccf-42c1-8506-330d9bd047d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea693993-22b8-44de-927e-b5651e7e4bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea693993-22b8-44de-927e-b5651e7e4bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1750889306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c4f366-46dd-4792-b4cc-65821c402d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9152da3556469c85e5bd93d80a1bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:14:36Z,use_quota=True,user_id='1ac308355f10443f872393f946c5fe07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fff0dd0-86ab-4d6b-9146-652f9167cefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fff0dd0-86ab-4d6b-9146-652f9167cefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7704a2cf-5d73-47e2-a798-30176682cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7704a2cf-5d73-47e2-a798-30176682cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c4f366-46dd-4792-b4cc-65821c402d1c', 'volume_name': 'volume-e5c4f366-46dd-4792-b4cc-65821c402d1c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8afb88a-1cb3-422e-9815-9e7e527e4324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8afb88a-1cb3-422e-9815-9e7e527e4324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f70bed1-e9de-4fce-aac8-c7100125e881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:36 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Volume e5c4f366-46dd-4792-b4cc-65821c402d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c4f366-46dd-4792-b4cc-65821c402d1c', 'volume_size': 1} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1750889306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c4f366-46dd-4792-b4cc-65821c402d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9152da3556469c85e5bd93d80a1bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:14:36Z,use_quota=True,user_id='1ac308355f10443f872393f946c5fe07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Creating volume e5c4f366-46dd-4792-b4cc-65821c402d1c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:14:36 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:14:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:36 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c 1073741824 Nov 05 22:14:36 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:37 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c 1073741824" returned: 0 in 0.591s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:37 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c Nov 05 22:14:37 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:37 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:14:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f70bed1-e9de-4fce-aac8-c7100125e881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c4f366-46dd-4792-b4cc-65821c402d1c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d802b022-632e-4aa8-aaca-812689be5e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Volume volume-e5c4f366-46dd-4792-b4cc-65821c402d1c (e5c4f366-46dd-4792-b4cc-65821c402d1c): created successfully Nov 05 22:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d802b022-632e-4aa8-aaca-812689be5e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Flow 'volume_create_manager' (236dfc24-cccf-42c1-8506-330d9bd047d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:14:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c5c9572f-1353-4fd8-9e16-3006102fd8a8 tempest-ServersNegativeTestJSON-2006314062 None] Created volume successfully. Nov 05 22:14:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Acquiring lock "cinder-e5c4f366-46dd-4792-b4cc-65821c402d1c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:14:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Lock "cinder-e5c4f366-46dd-4792-b4cc-65821c402d1c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:14:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Acquiring lock "cinder-quobyte-e5c4f366-46dd-4792-b4cc-65821c402d1c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:14:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Lock "cinder-quobyte-e5c4f366-46dd-4792-b4cc-65821c402d1c" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:14:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b0172f-e719-4d42-ab9c-9e138b57c857]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:14:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:41 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c Nov 05 22:14:41 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:41 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c" returned: 0 in 0.510s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:41 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c Nov 05 22:14:41 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:41 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e5c4f366-46dd-4792-b4cc-65821c402d1c" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Lock "cinder-quobyte-e5c4f366-46dd-4792-b4cc-65821c402d1c" released by "delete_volume" :: held 0.866s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Created reservations ['e6db9e2f-697a-431f-b272-afc1875f601f', 'e69db886-2d9d-4b71-a774-907a00ac907e', '182879df-fd25-4f31-8db5-5c8c1a6fea93', '83c5d1af-7321-4c05-9604-8f32b7874290'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:42 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:14:42 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Acquiring lock "cinder-ea9d6edf-d5c5-4cb9-ad88-7323833bee22-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Lock "cinder-ea9d6edf-d5c5-4cb9-ad88-7323833bee22-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Acquiring lock "cinder-quobyte-ea9d6edf-d5c5-4cb9-ad88-7323833bee22" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Lock "cinder-quobyte-ea9d6edf-d5c5-4cb9-ad88-7323833bee22" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e5c4b-1b73-4a9c-8433-2cca3e37f1db]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:42 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:14:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Deleted volume successfully. Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1dc9ea66-b45b-475f-9c4a-c092f595cf2a tempest-ServersNegativeTestJSON-2006314062 None] Lock "cinder-e5c4f366-46dd-4792-b4cc-65821c402d1c-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:14:42 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22 Nov 05 22:14:42 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:42 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22" returned: 0 in 0.561s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:42 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22 Nov 05 22:14:42 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:43 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ea9d6edf-d5c5-4cb9-ad88-7323833bee22" returned: 0 in 0.346s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Lock "cinder-quobyte-ea9d6edf-d5c5-4cb9-ad88-7323833bee22" released by "delete_volume" :: held 0.970s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:14:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Created reservations ['7cd52512-1abc-4259-a6a1-c29fc41b4929', 'a8c14cb5-f791-426f-84f9-f88e489f22b6', 'a782e573-8784-44cb-9f6e-baa901c1c625', 'dda5d0c8-510a-4dae-a671-7ccea85214cf'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:14:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:43 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:14:43 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:43 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.483s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:44 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:14:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Deleted volume successfully. Nov 05 22:14:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d18d4e2-a28f-48fa-bfd3-96b48c1c131a tempest-ServersNegativeTestJSON-2006314062 None] Lock "cinder-ea9d6edf-d5c5-4cb9-ad88-7323833bee22-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:14:53 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=35,cinder:SELECT=18,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:14:54 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:14:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:14:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:57 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:14:57 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:58 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.544s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:15:04 devstack cinder-volume[87122]: WARNING py.warnings [req-f8f739b0-2c84-4cba-aa06-7e3b5e38995a req-946f8bb0-bba2-428c-97e2-863f40339784 tempest-TaggedAttachmentsTest-515339989 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 05 22:15:04 devstack cinder-volume[87122]: .first() Nov 05 22:15:04 devstack cinder-volume[87122]: Nov 05 22:15:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f8f739b0-2c84-4cba-aa06-7e3b5e38995a req-946f8bb0-bba2-428c-97e2-863f40339784 tempest-TaggedAttachmentsTest-515339989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f8f739b0-2c84-4cba-aa06-7e3b5e38995a req-946f8bb0-bba2-428c-97e2-863f40339784 tempest-TaggedAttachmentsTest-515339989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f8f739b0-2c84-4cba-aa06-7e3b5e38995a req-946f8bb0-bba2-428c-97e2-863f40339784 tempest-TaggedAttachmentsTest-515339989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f8f739b0-2c84-4cba-aa06-7e3b5e38995a req-946f8bb0-bba2-428c-97e2-863f40339784 tempest-TaggedAttachmentsTest-515339989 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-c71bb055-75a2-4390-b29b-69dc01d938ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6e27f75-bf97-45fc-a041-91bad8af3784', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:15:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-f8f739b0-2c84-4cba-aa06-7e3b5e38995a req-946f8bb0-bba2-428c-97e2-863f40339784 tempest-TaggedAttachmentsTest-515339989 None] attachment_update completed successfully. Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Flow 'volume_create_manager' (db6f4947-a92e-4dd7-a039-7fea54f91dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab1b76a-8db2-413c-8af9-cfe9b5905d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab1b76a-8db2-413c-8af9-cfe9b5905d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-48606028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21fdba4-041e-4203-a722-c823406d96c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6fc3aa9baf74e38b423ab224387cce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:07Z,use_quota=True,user_id='6316c39ba41c4d088d9b4d60585c07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f12a7b-a3d7-47d6-a36e-0c18e9539aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f12a7b-a3d7-47d6-a36e-0c18e9539aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e7b563-e4d3-4e4d-8561-31c38f006d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e7b563-e4d3-4e4d-8561-31c38f006d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21fdba4-041e-4203-a722-c823406d96c7', 'volume_name': 'volume-f21fdba4-041e-4203-a722-c823406d96c7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdead8e6-09b7-4f69-b043-a679376296da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdead8e6-09b7-4f69-b043-a679376296da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc83df21-4911-4ec5-80d4-89547524f2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Volume f21fdba4-041e-4203-a722-c823406d96c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21fdba4-041e-4203-a722-c823406d96c7', 'volume_size': 1} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-48606028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21fdba4-041e-4203-a722-c823406d96c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6fc3aa9baf74e38b423ab224387cce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:07Z,use_quota=True,user_id='6316c39ba41c4d088d9b4d60585c07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Creating volume f21fdba4-041e-4203-a722-c823406d96c7 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:15:06 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:15:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:06 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7 1073741824 Nov 05 22:15:06 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:07 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7 1073741824" returned: 0 in 0.871s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:07 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7 Nov 05 22:15:07 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:08 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7" returned: 0 in 0.485s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:15:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc83df21-4911-4ec5-80d4-89547524f2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21fdba4-041e-4203-a722-c823406d96c7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e54d615-6e88-4e2b-a48e-830961db4a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Volume volume-f21fdba4-041e-4203-a722-c823406d96c7 (f21fdba4-041e-4203-a722-c823406d96c7): created successfully Nov 05 22:15:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e54d615-6e88-4e2b-a48e-830961db4a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Flow 'volume_create_manager' (db6f4947-a92e-4dd7-a039-7fea54f91dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-7e4d38c0-4875-4fe3-a580-832e9b5f9909 req-52abc570-28d1-40f4-9638-179546f7e9c4 tempest-VolumesGetTestJSON-1115280287 None] Created volume successfully. Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Flow 'volume_create_manager' (51c6197e-f50c-4472-ba13-a48668ee4232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe7d084-80b4-4dd3-b387-8876e008f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe7d084-80b4-4dd3-b387-8876e008f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-642636509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646dc941-a954-42a1-8bcb-602083c0b019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddbb618e14a4c07979621cfdd87dea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:09Z,use_quota=True,user_id='9a7b9dc8ce87469ea3936d5640403f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139c9392-b9eb-4989-a51a-47cee83d78ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139c9392-b9eb-4989-a51a-47cee83d78ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760f2407-1783-4aa8-a922-4cf964864927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760f2407-1783-4aa8-a922-4cf964864927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646dc941-a954-42a1-8bcb-602083c0b019', 'volume_name': 'volume-646dc941-a954-42a1-8bcb-602083c0b019', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56fe749-2ce3-4843-9d80-98d8afb3ad2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56fe749-2ce3-4843-9d80-98d8afb3ad2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b741cf3-71db-476c-a4c0-bf3e9de55ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:09 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Volume 646dc941-a954-42a1-8bcb-602083c0b019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646dc941-a954-42a1-8bcb-602083c0b019', 'volume_size': 1} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-642636509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646dc941-a954-42a1-8bcb-602083c0b019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ddbb618e14a4c07979621cfdd87dea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:09Z,use_quota=True,user_id='9a7b9dc8ce87469ea3936d5640403f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Creating volume 646dc941-a954-42a1-8bcb-602083c0b019 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:15:09 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:09 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019 1073741824 Nov 05 22:15:09 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Acquiring lock "cinder-f21fdba4-041e-4203-a722-c823406d96c7-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Lock "cinder-f21fdba4-041e-4203-a722-c823406d96c7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Acquiring lock "cinder-quobyte-f21fdba4-041e-4203-a722-c823406d96c7" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Lock "cinder-quobyte-f21fdba4-041e-4203-a722-c823406d96c7" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[817eeabc-2f05-4278-8d9f-6e23052d2370]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:09 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7 Nov 05 22:15:09 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:10 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019 1073741824" returned: 0 in 0.801s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:10 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019 Nov 05 22:15:10 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:10 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7" returned: 0 in 0.752s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:10 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7 Nov 05 22:15:10 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:10 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019" returned: 0 in 0.330s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b741cf3-71db-476c-a4c0-bf3e9de55ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646dc941-a954-42a1-8bcb-602083c0b019', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc54693-af7c-4141-8b95-6fbeb5bafb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:10 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Volume volume-646dc941-a954-42a1-8bcb-602083c0b019 (646dc941-a954-42a1-8bcb-602083c0b019): created successfully Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc54693-af7c-4141-8b95-6fbeb5bafb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Flow 'volume_create_manager' (51c6197e-f50c-4472-ba13-a48668ee4232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6d27b8b1-d3f0-4143-8376-ca7ffd745292 tempest-ServerRescueNegativeTestJSON-2079858034 None] Created volume successfully. Nov 05 22:15:10 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f21fdba4-041e-4203-a722-c823406d96c7" returned: 0 in 0.444s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Lock "cinder-quobyte-f21fdba4-041e-4203-a722-c823406d96c7" released by "delete_volume" :: held 1.285s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:10 devstack cinder-volume[87122]: DEBUG cinder.quota [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Created reservations ['952f4548-2811-4beb-b1b6-9b00c6f52dca', 'd6db7280-bdaf-4157-9f18-bdd3e5c25d04', 'e1ef6b62-ae0c-4cfa-a0b8-d6bcdd5f3e16', '0b45439a-5a85-46fd-920a-b201cbf26bc7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:11 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:15:11 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-a0544cf4-0fb4-4558-b782-fd9775fb9200 req-01829ec4-6b4e-41a0-a366-9b2739f9ccbc tempest-TaggedAttachmentsTest-515339989 None] Terminate volume connection completed successfully. Nov 05 22:15:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a0544cf4-0fb4-4558-b782-fd9775fb9200 req-01829ec4-6b4e-41a0-a366-9b2739f9ccbc tempest-TaggedAttachmentsTest-515339989 None] Deleting attachment a6e27f75-bf97-45fc-a041-91bad8af3784. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:15:11 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.481s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:11 devstack cinder-volume[87122]: DEBUG cinder.manager [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:15:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Deleted volume successfully. Nov 05 22:15:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-47192594-f291-4906-9c51-86fa1d4816cb req-5ae6205a-ca6b-4352-bc3b-c6ffeaf86a1a tempest-VolumesGetTestJSON-1115280287 None] Lock "cinder-f21fdba4-041e-4203-a722-c823406d96c7-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:21 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:15:21 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=16,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:15:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-361c21cb-dc40-4377-ba48-0fbeaa42bfb0 tempest-BackendsCapabilitiesAdminTestsJSON-163775642 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.367332458496, 'free_capacity_gb': 1773.367332458496, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87122) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 22:15:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9eaec4eb-7889-4843-ae1b-f840510b9770 tempest-BackendsCapabilitiesAdminTestsJSON-163775642 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.367332458496, 'free_capacity_gb': 1773.367332458496, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87122) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 22:15:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Acquiring lock "cinder-646dc941-a954-42a1-8bcb-602083c0b019-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Lock "cinder-646dc941-a954-42a1-8bcb-602083c0b019-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Acquiring lock "cinder-quobyte-646dc941-a954-42a1-8bcb-602083c0b019" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Lock "cinder-quobyte-646dc941-a954-42a1-8bcb-602083c0b019" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:29 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a5524f-131e-4ba8-bb3c-f3cc83618ad6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:29 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019 Nov 05 22:15:29 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:30 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019" returned: 0 in 1.136s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:30 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019 Nov 05 22:15:30 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:31 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-646dc941-a954-42a1-8bcb-602083c0b019" returned: 0 in 0.634s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Lock "cinder-quobyte-646dc941-a954-42a1-8bcb-602083c0b019" released by "delete_volume" :: held 1.881s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:31 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Created reservations ['b8496608-c79b-458b-9760-14c127b0d15f', 'a211de44-4e1b-47fd-973b-e933c48ec6eb', 'fd4bdb27-8f63-43d5-84cc-4d587781e311', '4ff6b3a8-c14b-40dd-a89c-52568b483bc4'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:31 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:15:31 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Acquiring lock "cinder-c71bb055-75a2-4390-b29b-69dc01d938ca-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Lock "cinder-c71bb055-75a2-4390-b29b-69dc01d938ca-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Acquiring lock "cinder-quobyte-c71bb055-75a2-4390-b29b-69dc01d938ca" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Lock "cinder-quobyte-c71bb055-75a2-4390-b29b-69dc01d938ca" acquired by "delete_volume" :: waited 0.079s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:32 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 1.015s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:32 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:15:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b78e0f-e88c-476b-b153-c72ca4e0b8da]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Deleted volume successfully. Nov 05 22:15:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3ccde7e8-5b2d-4206-a46e-cc0ce666cedb tempest-ServerRescueNegativeTestJSON-2079858034 None] Lock "cinder-646dc941-a954-42a1-8bcb-602083c0b019-delete_volume" released by "delete_volume" :: held 3.962s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:33 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca Nov 05 22:15:33 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:33 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca" returned: 0 in 1.061s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:33 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca Nov 05 22:15:33 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:34 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c71bb055-75a2-4390-b29b-69dc01d938ca" returned: 0 in 0.404s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Lock "cinder-quobyte-c71bb055-75a2-4390-b29b-69dc01d938ca" released by "delete_volume" :: held 1.686s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Created reservations ['5fb381c0-9fd0-4ad9-a56f-92071520e9af', 'f6de62b8-ff38-42fb-84d0-c0ebd109a609', 'b5324d8f-23de-4b1e-b928-f23f2423b63b', '17435d0b-1b4e-4967-86eb-ff899f0fba99'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:34 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:15:34 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:35 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.772s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:35 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:15:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Deleted volume successfully. Nov 05 22:15:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-174ca408-682c-4dc6-b30a-bde58d9dce53 tempest-TaggedAttachmentsTest-515339989 None] Lock "cinder-c71bb055-75a2-4390-b29b-69dc01d938ca-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Flow 'volume_create_manager' (c7aa82af-2fda-42da-9d77-236cb759e498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e767c57b-723b-49d5-b847-df7791d7d1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e767c57b-723b-49d5-b847-df7791d7d1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-511089996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d763e8-6404-492d-a366-1bbae4db85c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2fa01be99b4adea8d72e0f800f5c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:38Z,use_quota=True,user_id='5c0c0aa00414477eae35b3873b842598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af16215-f4c3-43cf-967e-20990c024f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af16215-f4c3-43cf-967e-20990c024f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e54827-a4de-469a-b78c-088de56561fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e54827-a4de-469a-b78c-088de56561fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d763e8-6404-492d-a366-1bbae4db85c3', 'volume_name': 'volume-70d763e8-6404-492d-a366-1bbae4db85c3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f566a85-fc65-44b1-bdcc-9e78a76bfe69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f566a85-fc65-44b1-bdcc-9e78a76bfe69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098d2a26-9041-484a-a9a2-19ae6f8e1c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Volume 70d763e8-6404-492d-a366-1bbae4db85c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d763e8-6404-492d-a366-1bbae4db85c3', 'volume_size': 1} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-511089996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d763e8-6404-492d-a366-1bbae4db85c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2fa01be99b4adea8d72e0f800f5c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:38Z,use_quota=True,user_id='5c0c0aa00414477eae35b3873b842598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Creating volume 70d763e8-6404-492d-a366-1bbae4db85c3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:15:38 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:38 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3 1073741824 Nov 05 22:15:38 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:38 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3 1073741824" returned: 0 in 0.632s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aa17f01a-17e3-45f1-9aee-5d5f368e120d tempest-GroupSnapshotsTest-2066268669 None] Group tempest-GroupSnapshotsTest-Group-1309044352: creating Nov 05 22:15:39 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3 Nov 05 22:15:39 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aa17f01a-17e3-45f1-9aee-5d5f368e120d tempest-GroupSnapshotsTest-2066268669 None] Group tempest-GroupSnapshotsTest-Group-1309044352: created successfully Nov 05 22:15:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aa17f01a-17e3-45f1-9aee-5d5f368e120d tempest-GroupSnapshotsTest-2066268669 None] Create group completed successfully. Nov 05 22:15:39 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3" returned: 0 in 0.623s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:15:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098d2a26-9041-484a-a9a2-19ae6f8e1c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d763e8-6404-492d-a366-1bbae4db85c3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8b1958-458c-458a-bafc-7dfa7c556df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Volume volume-70d763e8-6404-492d-a366-1bbae4db85c3 (70d763e8-6404-492d-a366-1bbae4db85c3): created successfully Nov 05 22:15:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8b1958-458c-458a-bafc-7dfa7c556df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Flow 'volume_create_manager' (c7aa82af-2fda-42da-9d77-236cb759e498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-67a413b7-37f3-4ff6-8664-d2a97b95d2bc tempest-DeleteServersTestJSON-908937551 None] Created volume successfully. Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Flow 'volume_create_manager' (d3bd3b50-e0f2-45ef-8abc-e310bc1f452f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3b8caa-4281-4bce-a713-63b81853a0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3b8caa-4281-4bce-a713-63b81853a0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-989297788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa2a0aba-11bf-4446-8e75-f02e2e03fbc6,host='devstack@QuobyteHD#QuobyteHD',id=503e1a62-ab8c-4278-9da0-dd8b63d7830f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77ca5b31a6e4b278a9170b6c52cd484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:41Z,use_quota=True,user_id='5e0cbe510f7a4537b7b02e9a02c408e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d773544-87aa-42be-bc07-22ccc559fb93),volume_type_id=8d773544-87aa-42be-bc07-22ccc559fb93)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebe9c54-653e-4117-a763-4c427464dc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebe9c54-653e-4117-a763-4c427464dc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af05377-8377-4e91-8949-9d4d7acdb029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af05377-8377-4e91-8949-9d4d7acdb029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503e1a62-ab8c-4278-9da0-dd8b63d7830f', 'volume_name': 'volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e244b4-face-4030-95dc-032f2e81afe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e244b4-face-4030-95dc-032f2e81afe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef154fc-788b-4eba-86bb-ebd2da62d319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Volume 503e1a62-ab8c-4278-9da0-dd8b63d7830f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f', 'volume_size': 1} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aa2a0aba-11bf-4446-8e75-f02e2e03fbc6,created_at=2026-11-05T21:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-989297788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa2a0aba-11bf-4446-8e75-f02e2e03fbc6,host='devstack@QuobyteHD#QuobyteHD',id=503e1a62-ab8c-4278-9da0-dd8b63d7830f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77ca5b31a6e4b278a9170b6c52cd484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:41Z,use_quota=True,user_id='5e0cbe510f7a4537b7b02e9a02c408e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d773544-87aa-42be-bc07-22ccc559fb93),volume_type_id=8d773544-87aa-42be-bc07-22ccc559fb93)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Creating volume 503e1a62-ab8c-4278-9da0-dd8b63d7830f {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:15:41 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:41 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f 1073741824 Nov 05 22:15:41 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-679eafb9-1c16-42b7-b468-89fc98bdefb6 req-4679a4ee-1c15-4865-b0ec-16b91a9fb9c7 tempest-DeleteServersTestJSON-908937551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:42 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f 1073741824" returned: 0 in 0.688s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:42 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f Nov 05 22:15:42 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:42 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f" returned: 0 in 0.450s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-679eafb9-1c16-42b7-b468-89fc98bdefb6 req-4679a4ee-1c15-4865-b0ec-16b91a9fb9c7 tempest-DeleteServersTestJSON-908937551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.931s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-679eafb9-1c16-42b7-b468-89fc98bdefb6 req-4679a4ee-1c15-4865-b0ec-16b91a9fb9c7 tempest-DeleteServersTestJSON-908937551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef154fc-788b-4eba-86bb-ebd2da62d319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b40d2a-5926-41dd-8a4f-40f0c1b909ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Volume volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f (503e1a62-ab8c-4278-9da0-dd8b63d7830f): created successfully Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b40d2a-5926-41dd-8a4f-40f0c1b909ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Flow 'volume_create_manager' (d3bd3b50-e0f2-45ef-8abc-e310bc1f452f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-987c87c4-0ee9-4d46-9e58-a742740462f0 tempest-GroupSnapshotsTest-2066268669 None] Created volume successfully. Nov 05 22:15:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-679eafb9-1c16-42b7-b468-89fc98bdefb6 req-4679a4ee-1c15-4865-b0ec-16b91a9fb9c7 tempest-DeleteServersTestJSON-908937551 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-70d763e8-6404-492d-a366-1bbae4db85c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee31713d-6822-41e1-9853-ccf0ac3ade76', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:15:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-679eafb9-1c16-42b7-b468-89fc98bdefb6 req-4679a4ee-1c15-4865-b0ec-16b91a9fb9c7 tempest-DeleteServersTestJSON-908937551 None] attachment_update completed successfully. Nov 05 22:15:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] GroupSnapshot f94ad55c-4e0e-45ec-94d1-b5742cecd44d: creating. Nov 05 22:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Group snapshot f94ad55c-4e0e-45ec-94d1-b5742cecd44d: creating. {{(pid=87122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 22:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Creating offline snapshot 0caa1117-f1c8-428c-8436-ec453fbb44be of volume 503e1a62-ab8c-4278-9da0-dd8b63d7830f {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:15:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aced7bec-d978-4829-a363-baa246313ff5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:44 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f Nov 05 22:15:44 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:44 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f" returned: 0 in 0.559s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:44 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be 1G Nov 05 22:15:44 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:45 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be 1G" returned: 0 in 0.868s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:45 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be Nov 05 22:15:45 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:46 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be" returned: 0 in 0.496s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:46 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:15:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:46 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be Nov 05 22:15:46 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:46 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be" returned: 0 in 0.366s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:46 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.info Nov 05 22:15:46 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:46 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.info" returned: 0 in 0.325s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:46 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:15:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:47 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.info Nov 05 22:15:47 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:47 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.info" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.023s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-37452ed3-7b96-4568-8fb3-9abe019bc61e tempest-GroupSnapshotsTest-2066268669 None] group_snapshot f94ad55c-4e0e-45ec-94d1-b5742cecd44d: created successfully Nov 05 22:15:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-c1f86012-43b3-48c2-9ae7-d0fd2fe6d0ca req-ab8ba3a2-85c5-4092-a403-39fc686f74e4 tempest-DeleteServersTestJSON-908937551 None] Terminate volume connection completed successfully. Nov 05 22:15:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-c1f86012-43b3-48c2-9ae7-d0fd2fe6d0ca req-ab8ba3a2-85c5-4092-a403-39fc686f74e4 tempest-DeleteServersTestJSON-908937551 None] Deleting attachment ee31713d-6822-41e1-9853-ccf0ac3ade76. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-0caa1117-f1c8-428c-8436-ec453fbb44be-a15f8a66-d6f3-40a2-9901-db20b1b45e07" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-0caa1117-f1c8-428c-8436-ec453fbb44be-a15f8a66-d6f3-40a2-9901-db20b1b45e07" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Creating volume a15f8a66-d6f3-40a2-9901-db20b1b45e07 from snapshot 0caa1117-f1c8-428c-8436-ec453fbb44be {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-a15f8a66-d6f3-40a2-9901-db20b1b45e07" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-a15f8a66-d6f3-40a2-9901-db20b1b45e07" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] snapshot: 0caa1117-f1c8-428c-8436-ec453fbb44be, volume: a15f8a66-d6f3-40a2-9901-db20b1b45e07, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9cfed2-c278-4dd2-a49a-9934d06e85f9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:49 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be Nov 05 22:15:49 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:49 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be" returned: 0 in 0.412s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb14fdd-9c17-4d5b-ab46-d5ec504fcd3c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:49 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f Nov 05 22:15:49 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:49 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f" returned: 0 in 0.515s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:15:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:50 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 Nov 05 22:15:50 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Acquiring lock "cinder-70d763e8-6404-492d-a366-1bbae4db85c3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Lock "cinder-70d763e8-6404-492d-a366-1bbae4db85c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Acquiring lock "cinder-quobyte-70d763e8-6404-492d-a366-1bbae4db85c3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Lock "cinder-quobyte-70d763e8-6404-492d-a366-1bbae4db85c3" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b3f37a-02c0-4aee-af97-648d0e4b1164]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:50 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3 Nov 05 22:15:50 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:50 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3" returned: 0 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:50 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3 Nov 05 22:15:50 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:51 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-70d763e8-6404-492d-a366-1bbae4db85c3" returned: 0 in 0.738s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Lock "cinder-quobyte-70d763e8-6404-492d-a366-1bbae4db85c3" released by "delete_volume" :: held 1.213s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:51 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Created reservations ['bb0d02de-734d-4f3e-bf5a-7bbfb3ac0e88', '53f8111f-fc9d-4208-b0de-f8735e721f98', 'ad256a66-22e2-4ede-864f-bb4c9b189b25', '34369fda-18be-4d29-ba99-fa9d76cb10af'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:51 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:15:51 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:52 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.591s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:15:52 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Deleted volume successfully. Nov 05 22:15:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dafa0253-579b-43b1-b8ad-dbd89f0ebdb6 tempest-DeleteServersTestJSON-908937551 None] Lock "cinder-70d763e8-6404-492d-a366-1bbae4db85c3-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Flow 'volume_create_manager' (77a5b68c-f778-4b4d-8d8f-db892539ce48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cca4014-e549-4e13-89f0-f33187439dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cca4014-e549-4e13-89f0-f33187439dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-699598163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc1d991-07d0-409e-bf53-2f8e59c7d2f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c842a6bb9274ae3b42c7709c2047c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:55Z,use_quota=True,user_id='4cdff1c8fe9a4124b863a85c762402c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9121af25-00db-4595-a46c-09af3aa989b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9121af25-00db-4595-a46c-09af3aa989b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd634dbc-c7aa-43a0-a9c4-43986c8f9554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd634dbc-c7aa-43a0-a9c4-43986c8f9554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc1d991-07d0-409e-bf53-2f8e59c7d2f0', 'volume_name': 'volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0749add5-ab47-4e5d-a1dc-d841a46f3778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0749add5-ab47-4e5d-a1dc-d841a46f3778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f90abd-8d96-4c85-ae63-eef71c0ec40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Volume 1cc1d991-07d0-409e-bf53-2f8e59c7d2f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0', 'volume_size': 1} Nov 05 22:15:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:57 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:15:57 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:57 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.342s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 8 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:15:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:15:58 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07" returned: 0 in 8.732s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:58 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:15:58 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Converted 1024.00 MB image at 117.25 MB/s Nov 05 22:15:58 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:15:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:58 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 Nov 05 22:15:58 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:59 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-a15f8a66-d6f3-40a2-9901-db20b1b45e07" released by "_copy_volume_from_snapshot" :: held 10.088s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-0caa1117-f1c8-428c-8436-ec453fbb44be-a15f8a66-d6f3-40a2-9901-db20b1b45e07" released by "_create_volume_from_snapshot" :: held 10.171s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.190s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.267s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-699598163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc1d991-07d0-409e-bf53-2f8e59c7d2f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c842a6bb9274ae3b42c7709c2047c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:55Z,use_quota=True,user_id='4cdff1c8fe9a4124b863a85c762402c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Creating volume 1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:15:59 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:59 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 1073741824 Nov 05 22:15:59 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-496df991-55f2-4882-b584-c2476fee923d tempest-GroupSnapshotsTest-2066268669 None] Create group from source-snapshot-f94ad55c-4e0e-45ec-94d1-b5742cecd44d completed successfully. Nov 05 22:15:59 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 1073741824" returned: 0 in 0.447s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:59 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 Nov 05 22:15:59 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:59 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0" returned: 0 in 0.304s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f90abd-8d96-4c85-ae63-eef71c0ec40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de6f472-0df9-4e6b-9722-2722ab5a5308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Volume volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 (1cc1d991-07d0-409e-bf53-2f8e59c7d2f0): created successfully Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de6f472-0df9-4e6b-9722-2722ab5a5308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Flow 'volume_create_manager' (77a5b68c-f778-4b4d-8d8f-db892539ce48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f9dddce1-3af1-4f49-af48-a2597dc1f36f tempest-VolumesTestJSON-378336054 None] Created volume successfully. Nov 05 22:16:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-a15f8a66-d6f3-40a2-9901-db20b1b45e07" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-a15f8a66-d6f3-40a2-9901-db20b1b45e07" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f60fba1-c30f-4176-a6a8-8ab7e8761497]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:00 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 Nov 05 22:16:00 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:01 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:01 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07 Nov 05 22:16:01 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:01 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a15f8a66-d6f3-40a2-9901-db20b1b45e07" returned: 0 in 0.307s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-a15f8a66-d6f3-40a2-9901-db20b1b45e07" released by "delete_volume" :: held 0.870s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['9c954cf3-f876-4bc4-94a0-18012a4eece4'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:01 devstack cinder-volume[87122]: WARNING cinder.quota [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-395346104 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-395346104, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:01 devstack cinder-volume[87122]: WARNING cinder.quota [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-395346104 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-395346104, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['e9053973-18de-40cf-a332-8a6e768ccd5d', 'ba5f0276-8105-469a-8a00-813081446ef0', '0e0162b9-df42-4650-ac01-f0b25625bdc3', 'fe614bf9-ff10-4663-9541-54ad1f0f55fd'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:01 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:16:01 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Flow 'volume_create_manager' (ec26ec96-1a41-476a-a959-5783df706f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76753d6f-c659-4a5f-bee0-2ce8bf5e3056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76753d6f-c659-4a5f-bee0-2ce8bf5e3056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1016554432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cdf71c-3115-4a74-ad3b-39dfb3b5f708,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c842a6bb9274ae3b42c7709c2047c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:02Z,use_quota=True,user_id='4cdff1c8fe9a4124b863a85c762402c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d45f90a-f918-4098-a667-4a491b305758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d45f90a-f918-4098-a667-4a491b305758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86be1e04-b448-4622-b45f-92eb474b3bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86be1e04-b448-4622-b45f-92eb474b3bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9cdf71c-3115-4a74-ad3b-39dfb3b5f708', 'volume_name': 'volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1dec3b7-7202-46fb-b9e8-69a0fdff0801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1dec3b7-7202-46fb-b9e8-69a0fdff0801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e61bb0-2f8e-4d1a-89f1-852090ea8a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Volume b9cdf71c-3115-4a74-ad3b-39dfb3b5f708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708', 'volume_size': 1} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1016554432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cdf71c-3115-4a74-ad3b-39dfb3b5f708,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c842a6bb9274ae3b42c7709c2047c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:02Z,use_quota=True,user_id='4cdff1c8fe9a4124b863a85c762402c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Creating volume b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:01 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] group_snapshot f94ad55c-4e0e-45ec-94d1-b5742cecd44d: deleting Nov 05 22:16:01 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 1073741824 Nov 05 22:16:01 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] group_snapshot f94ad55c-4e0e-45ec-94d1-b5742cecd44d: deleting {{(pid=87122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-503e1a62-ab8c-4278-9da0-dd8b63d7830f" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-503e1a62-ab8c-4278-9da0-dd8b63d7830f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-0caa1117-f1c8-428c-8436-ec453fbb44be" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-0caa1117-f1c8-428c-8436-ec453fbb44be" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Deleting offline snapshot 0caa1117-f1c8-428c-8436-ec453fbb44be of volume 503e1a62-ab8c-4278-9da0-dd8b63d7830f {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] snapshot_file for this snap is: volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9204df-0a8d-45bb-a7bd-2f307c59a166]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:02 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.521s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5d873de2-391a-4cbc-9aa2-7b7bdd61bbe1 tempest-GroupSnapshotsTest-2066268669 None] Delete group completed successfully. Nov 05 22:16:02 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be Nov 05 22:16:02 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:02 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 1073741824" returned: 0 in 0.697s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:02 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 Nov 05 22:16:02 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:02 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be" returned: 0 in 0.495s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d598fd4d-1346-4758-906b-099464614654]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:02 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f Nov 05 22:16:02 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:02 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708" returned: 0 in 0.334s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e61bb0-2f8e-4d1a-89f1-852090ea8a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e55362-d7da-44ab-b6ae-49ae98eefade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Volume volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 (b9cdf71c-3115-4a74-ad3b-39dfb3b5f708): created successfully Nov 05 22:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e55362-d7da-44ab-b6ae-49ae98eefade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Flow 'volume_create_manager' (ec26ec96-1a41-476a-a959-5783df706f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9ab9deb4-77d1-4448-a1fd-b199edc8fcc7 tempest-VolumesTestJSON-378336054 None] Created volume successfully. Nov 05 22:16:03 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f" returned: 0 in 0.579s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:03 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be Nov 05 22:16:03 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:03 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be" returned: 0 in 0.416s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:03 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be Nov 05 22:16:03 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:04 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f.0caa1117-f1c8-428c-8436-ec453fbb44be" returned: 0 in 0.323s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-0caa1117-f1c8-428c-8436-ec453fbb44be" released by "_delete_snapshot" :: held 2.023s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-503e1a62-ab8c-4278-9da0-dd8b63d7830f" released by "delete_snapshot" :: held 2.076s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:04 devstack cinder-volume[87122]: WARNING cinder.quota [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-395346104 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-395346104, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['db0d1439-cad8-46c5-83bd-0c240d5fd2af', 'ea2ecb92-344b-444f-89d4-cf7f3618a683', '75f801ec-1dbe-4ead-9c7f-a07768b3e863', '4db547be-d76c-436a-b043-ede4e20c4f15'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6337712c-0f6e-4404-9809-b582b2b62067 tempest-GroupSnapshotsTest-2066268669 None] group_snapshot f94ad55c-4e0e-45ec-94d1-b5742cecd44d: deleted successfully Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Flow 'volume_create_manager' (33b5ea62-82dc-45dd-bc84-639e40eed08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21dc173-6088-42c0-b135-b8be4cfdaf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e21dc173-6088-42c0-b135-b8be4cfdaf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-657132378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64ce57f-325d-40c7-9951-9283d4cfc652,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c842a6bb9274ae3b42c7709c2047c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:05Z,use_quota=True,user_id='4cdff1c8fe9a4124b863a85c762402c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a4c3e6-162b-46c6-9692-75f9afe1a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a4c3e6-162b-46c6-9692-75f9afe1a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76df086f-5564-4764-8899-46fb70f00a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76df086f-5564-4764-8899-46fb70f00a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64ce57f-325d-40c7-9951-9283d4cfc652', 'volume_name': 'volume-d64ce57f-325d-40c7-9951-9283d4cfc652', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4553a0bf-24d5-42cf-9ca5-820bf5816a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4553a0bf-24d5-42cf-9ca5-820bf5816a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f014b04c-db68-484f-b5d5-1453cebbde11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:04 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Volume d64ce57f-325d-40c7-9951-9283d4cfc652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64ce57f-325d-40c7-9951-9283d4cfc652', 'volume_size': 1} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-657132378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64ce57f-325d-40c7-9951-9283d4cfc652,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c842a6bb9274ae3b42c7709c2047c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:05Z,use_quota=True,user_id='4cdff1c8fe9a4124b863a85c762402c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Creating volume d64ce57f-325d-40c7-9951-9283d4cfc652 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:04 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:16:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:04 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652 1073741824 Nov 05 22:16:04 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:05 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652 1073741824" returned: 0 in 0.613s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:05 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652 Nov 05 22:16:05 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-503e1a62-ab8c-4278-9da0-dd8b63d7830f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-503e1a62-ab8c-4278-9da0-dd8b63d7830f" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[acba4152-266a-48ec-b64d-ba9e3b4c5cac]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:05 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652" returned: 0 in 0.517s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f014b04c-db68-484f-b5d5-1453cebbde11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64ce57f-325d-40c7-9951-9283d4cfc652', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743b2530-caa8-46f9-9c7d-c32826236f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:05 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Volume volume-d64ce57f-325d-40c7-9951-9283d4cfc652 (d64ce57f-325d-40c7-9951-9283d4cfc652): created successfully Nov 05 22:16:05 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f Nov 05 22:16:05 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743b2530-caa8-46f9-9c7d-c32826236f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Flow 'volume_create_manager' (33b5ea62-82dc-45dd-bc84-639e40eed08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7d3d77a2-0cba-47ec-94a1-acfe06fd2a31 tempest-VolumesTestJSON-378336054 None] Created volume successfully. Nov 05 22:16:06 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f" returned: 0 in 0.478s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:06 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f Nov 05 22:16:06 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:06 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-503e1a62-ab8c-4278-9da0-dd8b63d7830f" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-503e1a62-ab8c-4278-9da0-dd8b63d7830f" released by "delete_volume" :: held 0.838s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['cee1748d-ed4f-46a4-9dcc-1c176647c68b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:06 devstack cinder-volume[87122]: WARNING cinder.db.api [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-395346104'] Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['96e4effa-8f1d-4f60-b3d1-12e2fc7d8adc', '67514f8d-8e7a-4df0-b6fd-0fe48dd36022', '50c0e294-3703-46ad-aebf-ed61b3ab6222', '8ae93968-58c4-486a-995d-1dc89ec61449'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:06 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:16:06 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:07 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.350s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:07 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9f4d26f1-826d-47da-adcc-33a33224c6ff tempest-GroupSnapshotsTest-2066268669 None] Delete group completed successfully. Nov 05 22:16:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b92530e9-7985-4189-aab5-1d925cad654d tempest-GroupSnapshotsTest-2066268669 None] Group tempest-GroupSnapshotsTest-Group-696974030: creating Nov 05 22:16:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b92530e9-7985-4189-aab5-1d925cad654d tempest-GroupSnapshotsTest-2066268669 None] Group tempest-GroupSnapshotsTest-Group-696974030: created successfully Nov 05 22:16:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b92530e9-7985-4189-aab5-1d925cad654d tempest-GroupSnapshotsTest-2066268669 None] Create group completed successfully. Nov 05 22:16:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Acquiring lock "cinder-d64ce57f-325d-40c7-9951-9283d4cfc652-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Lock "cinder-d64ce57f-325d-40c7-9951-9283d4cfc652-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Acquiring lock "cinder-quobyte-d64ce57f-325d-40c7-9951-9283d4cfc652" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Lock "cinder-quobyte-d64ce57f-325d-40c7-9951-9283d4cfc652" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fa50bf-e58a-4a35-ae8a-44ea17a7ecea]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:08 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652 Nov 05 22:16:08 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:08 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652" returned: 0 in 0.398s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:08 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652 Nov 05 22:16:08 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:08 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d64ce57f-325d-40c7-9951-9283d4cfc652" returned: 0 in 0.324s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Lock "cinder-quobyte-d64ce57f-325d-40c7-9951-9283d4cfc652" released by "delete_volume" :: held 0.809s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Created reservations ['a30f4ffc-4375-4432-9ee5-188b2216b24f', '8933b7b6-3285-457c-ba4a-4f1ccb1658e8', '18a37575-abe0-4a42-b896-c39517e9de5c', 'd72f46ed-9456-4ce8-95d5-12d3af06939c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:09 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:16:09 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Acquiring lock "cinder-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Lock "cinder-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Acquiring lock "cinder-quobyte-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Lock "cinder-quobyte-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1427588-9f3b-4ebe-8ac1-182b3db71cb1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:09 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.363s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Deleted volume successfully. Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8098f72a-7929-4f6a-8201-69dc35c1c27d tempest-VolumesTestJSON-378336054 None] Lock "cinder-d64ce57f-325d-40c7-9951-9283d4cfc652-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:09 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 Nov 05 22:16:09 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:09 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708" returned: 0 in 0.434s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Flow 'volume_create_manager' (3f867445-79fc-4686-9293-f4f8bad4ae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c1e05c-7a6a-47c3-bbb7-19c22d5ab5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:10 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708 Nov 05 22:16:10 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c1e05c-7a6a-47c3-bbb7-19c22d5ab5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-327443631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a97e327-7fe2-4ea6-995a-a7d5587ba49d,host='devstack@QuobyteHD#QuobyteHD',id=f0eb111d-26dc-417e-9bd0-625d7aa31c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77ca5b31a6e4b278a9170b6c52cd484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:10Z,use_quota=True,user_id='5e0cbe510f7a4537b7b02e9a02c408e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8ae10a-f08d-40f1-a629-75d58289750f),volume_type_id=ed8ae10a-f08d-40f1-a629-75d58289750f)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16f1193-9ab6-4193-bab2-c416f0935654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16f1193-9ab6-4193-bab2-c416f0935654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17cb6bb-7e34-4fd4-b4b6-0b880ce7df16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17cb6bb-7e34-4fd4-b4b6-0b880ce7df16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0eb111d-26dc-417e-9bd0-625d7aa31c6c', 'volume_name': 'volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc204759-41a7-42e2-9014-9ec1a4792a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc204759-41a7-42e2-9014-9ec1a4792a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d36fbd-4a94-4485-a74f-554a9ade2e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:10 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Volume f0eb111d-26dc-417e-9bd0-625d7aa31c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c', 'volume_size': 1} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a97e327-7fe2-4ea6-995a-a7d5587ba49d,created_at=2026-11-05T21:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-327443631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a97e327-7fe2-4ea6-995a-a7d5587ba49d,host='devstack@QuobyteHD#QuobyteHD',id=f0eb111d-26dc-417e-9bd0-625d7aa31c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77ca5b31a6e4b278a9170b6c52cd484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:10Z,use_quota=True,user_id='5e0cbe510f7a4537b7b02e9a02c408e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8ae10a-f08d-40f1-a629-75d58289750f),volume_type_id=ed8ae10a-f08d-40f1-a629-75d58289750f)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Creating volume f0eb111d-26dc-417e-9bd0-625d7aa31c6c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:10 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:10 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c 1073741824 Nov 05 22:16:10 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:10 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708" returned: 0 in 0.363s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Lock "cinder-quobyte-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708" released by "delete_volume" :: held 0.878s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Created reservations ['7ada572f-44f3-41be-a10c-f709acaccf7d', '96980bea-51e3-47b9-aedc-95ec1efbe151', '4eb59b45-65b0-488f-9a2a-3d861cf16fed', '7b138337-53f5-49f5-b52e-839d1e5fcd61'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:10 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:16:10 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Acquiring lock "cinder-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Lock "cinder-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Acquiring lock "cinder-quobyte-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Lock "cinder-quobyte-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0" acquired by "delete_volume" :: waited 0.068s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:10 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c 1073741824" returned: 0 in 0.792s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f769e782-e5d5-4c8c-b6f5-65653bb691ba]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:11 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c Nov 05 22:16:11 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:11 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 Nov 05 22:16:11 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:11 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.665s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Deleted volume successfully. Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2cdb4961-96fb-499a-908a-b01a9a5f9435 tempest-VolumesTestJSON-378336054 None] Lock "cinder-b9cdf71c-3115-4a74-ad3b-39dfb3b5f708-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:11 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" returned: 0 in 0.454s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d36fbd-4a94-4485-a74f-554a9ade2e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:11 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38eb389-e8af-472c-b91b-2974f2895168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0" returned: 0 in 0.577s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:11 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Volume volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c (f0eb111d-26dc-417e-9bd0-625d7aa31c6c): created successfully Nov 05 22:16:11 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0 Nov 05 22:16:11 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38eb389-e8af-472c-b91b-2974f2895168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Flow 'volume_create_manager' (3f867445-79fc-4686-9293-f4f8bad4ae2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e819eee7-7afc-42a5-a636-f15a6b7e567a tempest-GroupSnapshotsTest-2066268669 None] Created volume successfully. Nov 05 22:16:11 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0" returned: 0 in 0.287s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Lock "cinder-quobyte-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0" released by "delete_volume" :: held 0.946s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Created reservations ['fe0e31e1-ef87-4ca4-aa58-ce2d47f57934', '61135118-f371-4cc4-87f8-abb47965ed7e', '0ede940e-c297-48c4-b125-6f62611dcf7f', 'fbd222ac-d4ed-4f71-8474-00b8454bfbb0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:12 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:16:12 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:12 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:12 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Deleted volume successfully. Nov 05 22:16:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-135bfc42-1962-43ba-8cc1-e3ee9008617d tempest-VolumesTestJSON-378336054 None] Lock "cinder-1cc1d991-07d0-409e-bf53-2f8e59c7d2f0-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Flow 'volume_create_manager' (4d330b50-4e97-479e-ba42-149ee9dec09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3e7c7c-18d5-4272-982e-7dcfca0d7e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3e7c7c-18d5-4272-982e-7dcfca0d7e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-474564918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a97e327-7fe2-4ea6-995a-a7d5587ba49d,host='devstack@QuobyteHD#QuobyteHD',id=4f3dae6d-fc34-4868-b29a-8b111db9915c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77ca5b31a6e4b278a9170b6c52cd484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:13Z,use_quota=True,user_id='5e0cbe510f7a4537b7b02e9a02c408e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8ae10a-f08d-40f1-a629-75d58289750f),volume_type_id=ed8ae10a-f08d-40f1-a629-75d58289750f)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1f03ef-0d1b-42d0-bc7d-b0ca9bb62f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1f03ef-0d1b-42d0-bc7d-b0ca9bb62f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dadedbc-7b92-414e-a9e9-54c4e5a4aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dadedbc-7b92-414e-a9e9-54c4e5a4aa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f3dae6d-fc34-4868-b29a-8b111db9915c', 'volume_name': 'volume-4f3dae6d-fc34-4868-b29a-8b111db9915c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dbbc1c-4629-4109-ad5c-5945b3ecf2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dbbc1c-4629-4109-ad5c-5945b3ecf2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d423c0fd-651f-44f1-a80d-f7471adce4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Volume 4f3dae6d-fc34-4868-b29a-8b111db9915c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f3dae6d-fc34-4868-b29a-8b111db9915c', 'volume_size': 1} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a97e327-7fe2-4ea6-995a-a7d5587ba49d,created_at=2026-11-05T21:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-474564918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a97e327-7fe2-4ea6-995a-a7d5587ba49d,host='devstack@QuobyteHD#QuobyteHD',id=4f3dae6d-fc34-4868-b29a-8b111db9915c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77ca5b31a6e4b278a9170b6c52cd484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:13Z,use_quota=True,user_id='5e0cbe510f7a4537b7b02e9a02c408e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8ae10a-f08d-40f1-a629-75d58289750f),volume_type_id=ed8ae10a-f08d-40f1-a629-75d58289750f)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Creating volume 4f3dae6d-fc34-4868-b29a-8b111db9915c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:13 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:16:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:13 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c 1073741824 Nov 05 22:16:13 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:14 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c 1073741824" returned: 0 in 0.639s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:14 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c Nov 05 22:16:14 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:14 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d423c0fd-651f-44f1-a80d-f7471adce4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f3dae6d-fc34-4868-b29a-8b111db9915c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f278e8cc-6306-4490-9ac7-99abd0232cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Volume volume-4f3dae6d-fc34-4868-b29a-8b111db9915c (4f3dae6d-fc34-4868-b29a-8b111db9915c): created successfully Nov 05 22:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f278e8cc-6306-4490-9ac7-99abd0232cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Flow 'volume_create_manager' (4d330b50-4e97-479e-ba42-149ee9dec09b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-80112ed9-c335-4303-997d-085c892c27c3 tempest-GroupSnapshotsTest-2066268669 None] Created volume successfully. Nov 05 22:16:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-cdac91ad-de11-4087-a4f5-3d9f1ef47711 tempest-GroupSnapshotsTest-2066268669 None] Update group completed successfully. Nov 05 22:16:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bbd4f282-7fd4-42a4-aea2-48be9d3ff71c tempest-GroupSnapshotsTest-2066268669 None] Update group completed successfully. Nov 05 22:16:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-396fe142-dd8d-43b5-a084-b08921da5afd tempest-GroupSnapshotsTest-2066268669 None] Update group completed successfully. Nov 05 22:16:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5568025b-eb49-41a6-9995-e38feb6b6da4 tempest-GroupSnapshotsTest-2066268669 None] Update group completed successfully. Nov 05 22:16:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] GroupSnapshot c6de7cd6-9ce7-46a8-af49-3999873d2ab2: creating. Nov 05 22:16:21 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=93,cinder:INSERT=23,cinder:UPDATE=99,cinder:DELETE=6 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:16:21 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=117,cinder:SELECT=104,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:16:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Group snapshot c6de7cd6-9ce7-46a8-af49-3999873d2ab2: creating. {{(pid=87122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 22:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Creating offline snapshot 5776f06e-b8fb-401a-8b2f-293ce9ba96b6 of volume f0eb111d-26dc-417e-9bd0-625d7aa31c6c {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:16:21 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[27919f6c-c228-4b0e-9ae6-e0712c618504]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:22 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c Nov 05 22:16:22 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:22 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" returned: 0 in 0.460s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:22 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 1G Nov 05 22:16:22 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:23 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 1G" returned: 0 in 0.725s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:23 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 Nov 05 22:16:23 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:23 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6" returned: 0 in 0.413s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:23 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:23 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 Nov 05 22:16:23 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:24 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6" returned: 0 in 0.458s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:24 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.info Nov 05 22:16:24 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:24 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.info" returned: 0 in 0.542s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:24 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:24 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.info Nov 05 22:16:24 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:25 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.info" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.181s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Creating offline snapshot 65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb of volume 4f3dae6d-fc34-4868-b29a-8b111db9915c {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:16:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[167322a1-b86f-45e5-8acf-886718b1f595]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:25 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c Nov 05 22:16:25 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:25 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c" returned: 0 in 0.552s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:25 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb 1G Nov 05 22:16:25 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:26 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb 1G" returned: 0 in 0.770s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f3dae6d-fc34-4868-b29a-8b111db9915c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:26 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f3dae6d-fc34-4868-b29a-8b111db9915c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb Nov 05 22:16:26 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:27 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f3dae6d-fc34-4868-b29a-8b111db9915c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb" returned: 0 in 0.772s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:27 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:27 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb Nov 05 22:16:27 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:27 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb" returned: 0 in 0.515s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:27 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.info Nov 05 22:16:27 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:28 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.info" returned: 0 in 0.470s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:28 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:28 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.info Nov 05 22:16:28 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d0a1c18e-d42d-415a-b101-eefdfff9813e tempest-GroupsV314Test-1877667632 None] Group tempest-GroupsV314Test-Group-1934015028: creating Nov 05 22:16:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d0a1c18e-d42d-415a-b101-eefdfff9813e tempest-GroupsV314Test-1877667632 None] Group tempest-GroupsV314Test-Group-1934015028: created successfully Nov 05 22:16:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d0a1c18e-d42d-415a-b101-eefdfff9813e tempest-GroupsV314Test-1877667632 None] Create group completed successfully. Nov 05 22:16:29 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.info" returned: 0 in 0.722s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.982s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d8f67d4e-50d4-489e-8f88-75875a3923b5 tempest-GroupSnapshotsTest-2066268669 None] group_snapshot c6de7cd6-9ce7-46a8-af49-3999873d2ab2: created successfully Nov 05 22:16:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] group_snapshot c6de7cd6-9ce7-46a8-af49-3999873d2ab2: deleting Nov 05 22:16:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] group_snapshot c6de7cd6-9ce7-46a8-af49-3999873d2ab2: deleting {{(pid=87122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 22:16:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-5776f06e-b8fb-401a-8b2f-293ce9ba96b6" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-5776f06e-b8fb-401a-8b2f-293ce9ba96b6" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Deleting offline snapshot 5776f06e-b8fb-401a-8b2f-293ce9ba96b6 of volume f0eb111d-26dc-417e-9bd0-625d7aa31c6c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:16:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] snapshot_file for this snap is: volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:16:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2801f47c-e390-4350-8f45-3b30a765bb94]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:30 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 Nov 05 22:16:30 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Flow 'volume_create_manager' (1e2957f5-7474-4340-8f09-385ed2938c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:31 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1422cfaa-11e8-4a8f-b73d-cd5fdfbf17f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6" returned: 0 in 1.099s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa3eec8-e4e0-4f85-a9f2-d042b7c194f8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1422cfaa-11e8-4a8f-b73d-cd5fdfbf17f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1462605789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19edfb6c-3abe-4267-b900-d58685fb334f,host='devstack@QuobyteHD#QuobyteHD',id=e6eac7c4-f823-4443-ab39-6dd5ae6cf461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34233944705a45b8ab1b565615c4f2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:31Z,use_quota=True,user_id='89cf8b40d98945bfbad51a9ab423c5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95dd6ebf-b9c2-445c-a42c-78a9cfb4f136),volume_type_id=95dd6ebf-b9c2-445c-a42c-78a9cfb4f136)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379214d9-a209-4ada-901d-d7c76b6f318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379214d9-a209-4ada-901d-d7c76b6f318b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac8ded6-e7ee-443c-b484-4a6a608541d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac8ded6-e7ee-443c-b484-4a6a608541d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6eac7c4-f823-4443-ab39-6dd5ae6cf461', 'volume_name': 'volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6d7355-db0f-4634-9b4f-23d560df2a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:31 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c Nov 05 22:16:31 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6d7355-db0f-4634-9b4f-23d560df2a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba988cb-db4c-43a9-8555-bae35854dc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Volume e6eac7c4-f823-4443-ab39-6dd5ae6cf461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461', 'volume_size': 1} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=19edfb6c-3abe-4267-b900-d58685fb334f,created_at=2026-11-05T21:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1462605789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19edfb6c-3abe-4267-b900-d58685fb334f,host='devstack@QuobyteHD#QuobyteHD',id=e6eac7c4-f823-4443-ab39-6dd5ae6cf461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34233944705a45b8ab1b565615c4f2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:31Z,use_quota=True,user_id='89cf8b40d98945bfbad51a9ab423c5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95dd6ebf-b9c2-445c-a42c-78a9cfb4f136),volume_type_id=95dd6ebf-b9c2-445c-a42c-78a9cfb4f136)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Creating volume e6eac7c4-f823-4443-ab39-6dd5ae6cf461 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:31 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:16:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:32 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 1073741824 Nov 05 22:16:32 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:32 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" returned: 0 in 0.742s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:32 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 Nov 05 22:16:32 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:32 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 1073741824" returned: 0 in 0.971s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:33 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 Nov 05 22:16:33 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:33 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6" returned: 0 in 0.963s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:33 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6 Nov 05 22:16:33 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:33 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461" returned: 0 in 0.571s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba988cb-db4c-43a9-8555-bae35854dc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac86f0ea-2ab5-4ecd-943b-7107982b5e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Volume volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 (e6eac7c4-f823-4443-ab39-6dd5ae6cf461): created successfully Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac86f0ea-2ab5-4ecd-943b-7107982b5e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Flow 'volume_create_manager' (1e2957f5-7474-4340-8f09-385ed2938c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-020aa7bf-1925-43bb-8490-8be07073c43a tempest-GroupsV314Test-1877667632 None] Created volume successfully. Nov 05 22:16:33 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c.5776f06e-b8fb-401a-8b2f-293ce9ba96b6" returned: 0 in 0.548s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-5776f06e-b8fb-401a-8b2f-293ce9ba96b6" released by "_delete_snapshot" :: held 3.657s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" released by "delete_snapshot" :: held 3.709s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-4f3dae6d-fc34-4868-b29a-8b111db9915c" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-4f3dae6d-fc34-4868-b29a-8b111db9915c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Deleting offline snapshot 65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb of volume 4f3dae6d-fc34-4868-b29a-8b111db9915c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:16:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] snapshot_file for this snap is: volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:16:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b61207-cdf0-4262-a5d5-69f6ac795e41]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:34 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb Nov 05 22:16:34 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:34 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb" returned: 0 in 0.892s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f3dae6d-fc34-4868-b29a-8b111db9915c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:16:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d029d5-7a7a-4085-889f-6180ff688453]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:35 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c Nov 05 22:16:35 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:35 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c" returned: 0 in 0.804s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:35 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb Nov 05 22:16:35 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:36 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Cloning volume e6eac7c4-f823-4443-ab39-6dd5ae6cf461 to volume 9e161e15-fa33-45e2-868a-e2b41c0fb172 Nov 05 22:16:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Creating offline snapshot 509bccca-f878-4f05-af19-6e0269d2f115 of volume e6eac7c4-f823-4443-ab39-6dd5ae6cf461 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:16:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6f933a-4008-44de-8a44-f636e51f2d85]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:36 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 Nov 05 22:16:36 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:36 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb" returned: 0 in 0.696s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:36 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb Nov 05 22:16:36 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:36 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461" returned: 0 in 0.695s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:36 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 1G Nov 05 22:16:36 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:37 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c.65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb" returned: 0 in 0.510s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-65cd8e0f-78ee-4a95-bb14-e0b2db6cffeb" released by "_delete_snapshot" :: held 3.111s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-4f3dae6d-fc34-4868-b29a-8b111db9915c" released by "delete_snapshot" :: held 3.158s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:37 devstack cinder-volume[87122]: WARNING cinder.quota [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1005171478 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1005171478, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:37 devstack cinder-volume[87122]: WARNING cinder.quota [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1005171478 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1005171478, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['b0917d0e-9a2b-4b88-8c9e-de983305c889', '6289cebe-c9bc-443f-9d3e-d599b104c360', 'e0136dc4-ba58-49a3-999b-ef0e2c5a8424', '987b2442-8c53-4699-af71-e7ae79df4cc3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:37 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 1G" returned: 0 in 0.528s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:37 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 Nov 05 22:16:37 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['d0a862b7-c330-4d4f-8ed3-1fcb5465cc8b', '21e243d3-7d42-4ffe-875f-6d80b509eb60', '0ac800c6-dd5b-422a-8558-03142c2e3e7b', 'b5c857b3-219b-42f2-919d-4ae12cca3ccb'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bf6a107b-a3a2-4031-bf6f-99596187032c tempest-GroupSnapshotsTest-2066268669 None] group_snapshot c6de7cd6-9ce7-46a8-af49-3999873d2ab2: deleted successfully Nov 05 22:16:37 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115" returned: 0 in 0.328s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:37 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:37 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 Nov 05 22:16:37 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:37 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:38 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.info Nov 05 22:16:38 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:38 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.info" returned: 0 in 0.246s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:38 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:38 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.info Nov 05 22:16:38 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:38 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.info" returned: 0 in 0.238s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Acquiring lock "cinder-quobyte-9e161e15-fa33-45e2-868a-e2b41c0fb172" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Lock "cinder-quobyte-9e161e15-fa33-45e2-868a-e2b41c0fb172" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] snapshot: 509bccca-f878-4f05-af19-6e0269d2f115, volume: 9e161e15-fa33-45e2-868a-e2b41c0fb172, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08ebab1-7d17-4c31-9135-f549966b1c8c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:38 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 Nov 05 22:16:38 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:38 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[902d2a95-0c03-4b7f-8812-017f9b1d4616]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:39 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 Nov 05 22:16:39 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-4f3dae6d-fc34-4868-b29a-8b111db9915c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-4f3dae6d-fc34-4868-b29a-8b111db9915c" acquired by "delete_volume" :: waited 0.041s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e9c020-698c-40c8-bfe4-4ae7571b7ea0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:39 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461" returned: 0 in 0.512s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:39 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c Nov 05 22:16:39 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:39 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 Nov 05 22:16:39 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:39 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c" returned: 0 in 0.530s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:39 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c Nov 05 22:16:39 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:40 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f3dae6d-fc34-4868-b29a-8b111db9915c" returned: 0 in 0.779s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-4f3dae6d-fc34-4868-b29a-8b111db9915c" released by "delete_volume" :: held 1.494s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" acquired by "delete_volume" :: waited 0.065s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c9c5d2-8d41-4dea-a3fb-0c1a7d8c652f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:41 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c Nov 05 22:16:41 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:42 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" returned: 0 in 1.581s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:42 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c Nov 05 22:16:42 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:43 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" returned: 0 in 0.624s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-f0eb111d-26dc-417e-9bd0-625d7aa31c6c" released by "delete_volume" :: held 2.515s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['e88816d6-c556-4896-8eb9-346bdb54e90a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:43 devstack cinder-volume[87122]: WARNING cinder.quota [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1005171478 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1005171478, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['13465c86-dbf9-4b64-9b67-b98be3c676f3', 'b5393abe-bf42-465d-ad41-525faf0e97e3', 'd5b0aee8-4a28-4e82-b2c1-6f6df27362ca', '926d8f96-955c-4d87-adcc-4e25b0457ce6'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:44 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['9d0d240e-d252-44f7-b2a3-6335addd798b', '4fb05107-8c42-40c2-a473-afc9693d45d0', '5d5a2e7f-40fa-4b00-babe-3411ac4b7bb6', '0818297e-29a6-4130-9784-d15ffe7403fc'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:44 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:16:44 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:44 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:44 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7da68cd3-0757-4e18-9b1a-bfb96dcbbf81 tempest-GroupSnapshotsTest-2066268669 None] Delete group completed successfully. Nov 05 22:16:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3d158cf5-5ecc-4fc5-bbe7-613ba99eb0ae tempest-GroupSnapshotsTest-2066268669 None] Group tempest-GroupSnapshotsTest-Group-1739637837: creating Nov 05 22:16:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3d158cf5-5ecc-4fc5-bbe7-613ba99eb0ae tempest-GroupSnapshotsTest-2066268669 None] Group tempest-GroupSnapshotsTest-Group-1739637837: created successfully Nov 05 22:16:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3d158cf5-5ecc-4fc5-bbe7-613ba99eb0ae tempest-GroupSnapshotsTest-2066268669 None] Create group completed successfully. Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Flow 'volume_create_manager' (ffc7459a-a517-4f6a-8142-61911cc9e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9963fbd-0210-4c7e-ac12-fe9c89b38ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9963fbd-0210-4c7e-ac12-fe9c89b38ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-994962491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4152811b-8d50-4930-9e2a-9de5cd2117b1,host='devstack@QuobyteHD#QuobyteHD',id=ee8092ce-a6b4-4296-9028-cb80eca8314b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77ca5b31a6e4b278a9170b6c52cd484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:48Z,use_quota=True,user_id='5e0cbe510f7a4537b7b02e9a02c408e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39673b44-9e8f-4fc6-88a3-071163e6e0e7),volume_type_id=39673b44-9e8f-4fc6-88a3-071163e6e0e7)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c44a66b-1e28-4600-978d-b5ba8c8dae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c44a66b-1e28-4600-978d-b5ba8c8dae15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe235ff-de77-4e4c-9db0-31b4414d9c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe235ff-de77-4e4c-9db0-31b4414d9c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8092ce-a6b4-4296-9028-cb80eca8314b', 'volume_name': 'volume-ee8092ce-a6b4-4296-9028-cb80eca8314b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b051ad12-6ac0-46dd-ae9b-d99ca4b45fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b051ad12-6ac0-46dd-ae9b-d99ca4b45fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb3eac3-40a4-437a-9b6a-d835daef6bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Volume ee8092ce-a6b4-4296-9028-cb80eca8314b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8092ce-a6b4-4296-9028-cb80eca8314b', 'volume_size': 1} Nov 05 22:16:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:48 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172" returned: 0 in 8.855s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461, size 1024.00 MB, duration 8.86 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:16:48 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Converted 1024.00 MB image at 115.63 MB/s Nov 05 22:16:48 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:48 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 Nov 05 22:16:48 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:48 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Lock "cinder-quobyte-9e161e15-fa33-45e2-868a-e2b41c0fb172" released by "_copy_volume_from_snapshot" :: held 10.097s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Acquiring lock "cinder-quobyte-509bccca-f878-4f05-af19-6e0269d2f115" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Lock "cinder-quobyte-509bccca-f878-4f05-af19-6e0269d2f115" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Deleting offline snapshot 509bccca-f878-4f05-af19-6e0269d2f115 of volume e6eac7c4-f823-4443-ab39-6dd5ae6cf461 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] snapshot_file for this snap is: volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1ef2c8-1173-4ed8-81b3-b5a2e1b994b8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:48 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 Nov 05 22:16:48 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:49 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115" returned: 0 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:16:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efa2413-4fdd-4f59-8065-0b501bfbd22c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:49 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 Nov 05 22:16:49 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:49 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461" returned: 0 in 0.487s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:49 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 Nov 05 22:16:49 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:49 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115" returned: 0 in 0.336s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:49 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115 Nov 05 22:16:49 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:50 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461.509bccca-f878-4f05-af19-6e0269d2f115" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Lock "cinder-quobyte-509bccca-f878-4f05-af19-6e0269d2f115" released by "_delete_snapshot" :: held 1.550s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.196s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.506s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4152811b-8d50-4930-9e2a-9de5cd2117b1,created_at=2026-11-05T21:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-994962491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4152811b-8d50-4930-9e2a-9de5cd2117b1,host='devstack@QuobyteHD#QuobyteHD',id=ee8092ce-a6b4-4296-9028-cb80eca8314b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77ca5b31a6e4b278a9170b6c52cd484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:48Z,use_quota=True,user_id='5e0cbe510f7a4537b7b02e9a02c408e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39673b44-9e8f-4fc6-88a3-071163e6e0e7),volume_type_id=39673b44-9e8f-4fc6-88a3-071163e6e0e7)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Creating volume ee8092ce-a6b4-4296-9028-cb80eca8314b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:50 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:50 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b 1073741824 Nov 05 22:16:50 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e18ee1b4-04be-4ef7-ae75-ba4647520bf8 tempest-GroupsV314Test-1877667632 None] Create group from source-group-19edfb6c-3abe-4267-b900-d58685fb334f completed successfully. Nov 05 22:16:50 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b 1073741824" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:50 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b Nov 05 22:16:50 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:50 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b" returned: 0 in 0.245s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb3eac3-40a4-437a-9b6a-d835daef6bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8092ce-a6b4-4296-9028-cb80eca8314b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18014834-5d11-4679-8c93-e0b583e20fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Volume volume-ee8092ce-a6b4-4296-9028-cb80eca8314b (ee8092ce-a6b4-4296-9028-cb80eca8314b): created successfully Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18014834-5d11-4679-8c93-e0b583e20fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Flow 'volume_create_manager' (ffc7459a-a517-4f6a-8142-61911cc9e196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bc6cf1f8-72bb-4b5d-9262-0234321cb9fb tempest-GroupSnapshotsTest-2066268669 None] Created volume successfully. Nov 05 22:16:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Acquiring lock "cinder-quobyte-9e161e15-fa33-45e2-868a-e2b41c0fb172" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Lock "cinder-quobyte-9e161e15-fa33-45e2-868a-e2b41c0fb172" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d82c2e-a649-4f9f-b2e1-d2b28ce3e033]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:51 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 Nov 05 22:16:51 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:52 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:52 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172 Nov 05 22:16:52 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:52 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:52 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] GroupSnapshot aba8b642-ed04-4d0d-b834-6698abae1187: creating. Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9e161e15-fa33-45e2-868a-e2b41c0fb172" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Lock "cinder-quobyte-9e161e15-fa33-45e2-868a-e2b41c0fb172" released by "delete_volume" :: held 0.706s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Group snapshot aba8b642-ed04-4d0d-b834-6698abae1187: creating. {{(pid=87122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Creating offline snapshot 67708746-4110-4d80-b6f7-28fb5f165c50 of volume ee8092ce-a6b4-4296-9028-cb80eca8314b {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e14e33-b783-4ee5-be50-43241f239aba]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Created reservations ['b7a20ba3-0ed1-482d-8ddb-6745f41ccdea'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:52 devstack cinder-volume[87122]: WARNING cinder.quota [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1204036628 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1204036628, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:52 devstack cinder-volume[87122]: WARNING cinder.quota [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1204036628 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1204036628, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Created reservations ['22cf36d5-08ab-46b9-a475-c4fe678f72c4', 'e035883f-b28c-42fb-92d7-c68ce6deccdf', 'c7142bad-2e42-41ee-917a-5d00c5c29dd6', '49e04fde-3d63-4bd7-955b-43381e82b930'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:52 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b Nov 05 22:16:52 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:52 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:16:52 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:53 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b" returned: 0 in 0.415s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:53 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.255s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c56cc2dc-c2a9-4ac8-aed7-f90461cda229 tempest-GroupsV314Test-1877667632 None] Delete group completed successfully. Nov 05 22:16:53 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 1G Nov 05 22:16:53 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Acquiring lock "cinder-quobyte-e6eac7c4-f823-4443-ab39-6dd5ae6cf461" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Lock "cinder-quobyte-e6eac7c4-f823-4443-ab39-6dd5ae6cf461" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b298928e-e5ca-4323-bd1e-722fca7ba2d0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:53 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 Nov 05 22:16:53 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:53 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 1G" returned: 0 in 0.447s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee8092ce-a6b4-4296-9028-cb80eca8314b -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:53 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee8092ce-a6b4-4296-9028-cb80eca8314b -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 Nov 05 22:16:53 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:53 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:53 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461 Nov 05 22:16:53 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:53 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee8092ce-a6b4-4296-9028-cb80eca8314b -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50" returned: 0 in 0.323s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:53 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:53 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 Nov 05 22:16:53 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:53 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e6eac7c4-f823-4443-ab39-6dd5ae6cf461" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Lock "cinder-quobyte-e6eac7c4-f823-4443-ab39-6dd5ae6cf461" released by "delete_volume" :: held 0.716s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:54 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50" returned: 0 in 0.249s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Created reservations ['dffee87a-fdce-4eec-ad51-8d4efc13f3be'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:54 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.info Nov 05 22:16:54 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Created reservations ['3609831e-76eb-48cf-9fcb-c48b77ff2e14', '1e7885aa-1254-43fd-ac42-b378d96b813e', '65a94b2a-32c7-460a-9403-2d3956a3f40e', '8f84c768-1472-4a01-ba0e-f72b0057874e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:54 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:16:54 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:54 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.info" returned: 0 in 0.272s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:54 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:54 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.info Nov 05 22:16:54 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:54 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8ef2ccb8-0e4e-45b5-a844-8daad9dfa43a tempest-GroupsV314Test-1877667632 None] Delete group completed successfully. Nov 05 22:16:54 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.info" returned: 0 in 0.332s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Flow 'volume_create_manager' (78d491ca-b6b7-4cc3-86db-d0c465facaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e571d78a-fa6b-4007-a37d-1f50351d2b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e571d78a-fa6b-4007-a37d-1f50351d2b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1993561287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d107632-2615-41cb-91f7-ea8061aa2a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2327e3bc9a2347b99e373a68457a8bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:55Z,use_quota=True,user_id='6892566974e94afeb82cd4542b1ebd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c8f6dd-f6bd-4672-a530-3524e82532a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c8f6dd-f6bd-4672-a530-3524e82532a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b906eef6-5396-4efe-b2e5-bbf0de2dd05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b906eef6-5396-4efe-b2e5-bbf0de2dd05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d107632-2615-41cb-91f7-ea8061aa2a74', 'volume_name': 'volume-6d107632-2615-41cb-91f7-ea8061aa2a74', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d47223-7a68-48b1-b063-6858de09d1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d47223-7a68-48b1-b063-6858de09d1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc0540e-858c-41c0-9ea6-4130676bbe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Volume 6d107632-2615-41cb-91f7-ea8061aa2a74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d107632-2615-41cb-91f7-ea8061aa2a74', 'volume_size': 1} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1993561287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d107632-2615-41cb-91f7-ea8061aa2a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2327e3bc9a2347b99e373a68457a8bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:55Z,use_quota=True,user_id='6892566974e94afeb82cd4542b1ebd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Creating volume 6d107632-2615-41cb-91f7-ea8061aa2a74 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:54 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:16:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ad71d6c3-320c-4138-96a9-3e3bdd147da8 tempest-GroupSnapshotsTest-2066268669 None] group_snapshot aba8b642-ed04-4d0d-b834-6698abae1187: created successfully Nov 05 22:16:54 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74 1073741824 Nov 05 22:16:54 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:55 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74 1073741824" returned: 0 in 0.516s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:55 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74 Nov 05 22:16:55 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:55 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74" returned: 0 in 0.348s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc0540e-858c-41c0-9ea6-4130676bbe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d107632-2615-41cb-91f7-ea8061aa2a74', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37114b9-6e77-4f6e-bbf6-a3025f17c767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Volume volume-6d107632-2615-41cb-91f7-ea8061aa2a74 (6d107632-2615-41cb-91f7-ea8061aa2a74): created successfully Nov 05 22:16:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37114b9-6e77-4f6e-bbf6-a3025f17c767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Flow 'volume_create_manager' (78d491ca-b6b7-4cc3-86db-d0c465facaaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-09842425-f980-4be4-b6a3-4bf3a99ce38c tempest-ServerActionsTestOtherA-1281941995 None] Created volume successfully. Nov 05 22:16:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] group_snapshot aba8b642-ed04-4d0d-b834-6698abae1187: deleting Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] group_snapshot aba8b642-ed04-4d0d-b834-6698abae1187: deleting {{(pid=87122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-ee8092ce-a6b4-4296-9028-cb80eca8314b" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-ee8092ce-a6b4-4296-9028-cb80eca8314b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-67708746-4110-4d80-b6f7-28fb5f165c50" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-67708746-4110-4d80-b6f7-28fb5f165c50" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Deleting offline snapshot 67708746-4110-4d80-b6f7-28fb5f165c50 of volume ee8092ce-a6b4-4296-9028-cb80eca8314b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] snapshot_file for this snap is: volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[661bf27e-91e3-4c78-9112-dc4d556f1f88]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:56 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 Nov 05 22:16:56 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:56 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50" returned: 0 in 0.532s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee8092ce-a6b4-4296-9028-cb80eca8314b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[16168421-4058-4a9e-b585-2f3f75383c8c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Flow 'volume_create_manager' (657f5f1b-482e-4c81-ace5-776bbceffa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b81739b-1c0a-4097-9b75-bafadade407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b81739b-1c0a-4097-9b75-bafadade407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2089397957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de3e44f-86db-4379-87f3-bb763e93feb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08de1648f1c4fc79529a45dff349f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:57Z,use_quota=True,user_id='25315620ba5e44bd8a056ec090881da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b03211-e561-423d-89d1-621a560b0ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b03211-e561-423d-89d1-621a560b0ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713012af-abea-41db-bc30-9ea27d43d4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713012af-abea-41db-bc30-9ea27d43d4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de3e44f-86db-4379-87f3-bb763e93feb9', 'volume_name': 'volume-2de3e44f-86db-4379-87f3-bb763e93feb9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b708949-2512-43f3-b3d2-c4c5494e1c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b708949-2512-43f3-b3d2-c4c5494e1c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60114ac6-5c0e-4e0d-8d41-3c28a2a82951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Volume 2de3e44f-86db-4379-87f3-bb763e93feb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de3e44f-86db-4379-87f3-bb763e93feb9', 'volume_size': 1} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2089397957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de3e44f-86db-4379-87f3-bb763e93feb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f08de1648f1c4fc79529a45dff349f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:57Z,use_quota=True,user_id='25315620ba5e44bd8a056ec090881da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Creating volume 2de3e44f-86db-4379-87f3-bb763e93feb9 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:56 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b Nov 05 22:16:56 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:56 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:16:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:56 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9 1073741824 Nov 05 22:16:56 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:57 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b" returned: 0 in 0.510s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:57 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 Nov 05 22:16:57 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:57 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9 1073741824" returned: 0 in 0.639s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:57 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9 Nov 05 22:16:57 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:57 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:16:57 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:57 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50" returned: 0 in 0.514s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:57 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50 Nov 05 22:16:57 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:57 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 8 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:16:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:16:58 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9" returned: 0 in 0.477s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60114ac6-5c0e-4e0d-8d41-3c28a2a82951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de3e44f-86db-4379-87f3-bb763e93feb9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f0e2a5-f3e9-45d7-8678-cc05fe5df5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Volume volume-2de3e44f-86db-4379-87f3-bb763e93feb9 (2de3e44f-86db-4379-87f3-bb763e93feb9): created successfully Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f0e2a5-f3e9-45d7-8678-cc05fe5df5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Flow 'volume_create_manager' (657f5f1b-482e-4c81-ace5-776bbceffa24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8b7d7378-6b6d-41e0-a94a-f1f2bc459a78 tempest-AttachVolumeShelveTestJSON-1156996809 None] Created volume successfully. Nov 05 22:16:58 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b.67708746-4110-4d80-b6f7-28fb5f165c50" returned: 0 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-67708746-4110-4d80-b6f7-28fb5f165c50" released by "_delete_snapshot" :: held 2.111s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-ee8092ce-a6b4-4296-9028-cb80eca8314b" released by "delete_snapshot" :: held 2.142s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:58 devstack cinder-volume[87122]: WARNING cinder.quota [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-367332780 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-367332780, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:58 devstack cinder-volume[87122]: WARNING cinder.quota [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-367332780 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-367332780, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:58 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['91201b1f-3fc0-4f35-a510-2c7f9f22e08d', 'e0fc1d4b-d040-4910-a149-11adfea10f63', '7be9bab5-a3bb-4f62-9e76-e6c2233bc2ed', '67adb260-2952-4aa8-83d0-7382253c1914'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e67352a3-b5e7-49a2-a3c7-bb827b329640 tempest-GroupSnapshotsTest-2066268669 None] group_snapshot aba8b642-ed04-4d0d-b834-6698abae1187: deleted successfully Nov 05 22:16:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "cinder-quobyte-ee8092ce-a6b4-4296-9028-cb80eca8314b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-ee8092ce-a6b4-4296-9028-cb80eca8314b" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2132db13-03f6-41ac-8d41-9ea5cd9e2977]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:00 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b Nov 05 22:17:00 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:00 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b" returned: 0 in 0.615s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:00 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b Nov 05 22:17:00 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:00 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ee8092ce-a6b4-4296-9028-cb80eca8314b" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Lock "cinder-quobyte-ee8092ce-a6b4-4296-9028-cb80eca8314b" released by "delete_volume" :: held 1.138s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['170ad68f-cfc5-4f97-85a1-969361c0f66b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:01 devstack cinder-volume[87122]: WARNING cinder.quota [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-367332780 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-367332780, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:17:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Created reservations ['5e317797-edaf-4833-94ca-ee0dac547ed9', '6def5333-b67f-4411-93f2-35f419799775', '75ed9827-7df4-4e81-953c-83065ee73b7f', '860da27c-afdd-4d7f-9d30-6760b801eba6'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:01 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:17:01 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:01 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:01 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f8cd1beb-7514-457d-b8c1-ab32b56cab77 tempest-GroupSnapshotsTest-2066268669 None] Delete group completed successfully. Nov 05 22:17:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0f73601a-78a5-4c93-8cf4-201fce4d5ad8 tempest-GroupsV320Test-1963834581 None] Group tempest-GroupsV320Test-Group-2002092469: creating Nov 05 22:17:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0f73601a-78a5-4c93-8cf4-201fce4d5ad8 tempest-GroupsV320Test-1963834581 None] Group tempest-GroupsV320Test-Group-2002092469: created successfully Nov 05 22:17:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0f73601a-78a5-4c93-8cf4-201fce4d5ad8 tempest-GroupsV320Test-1963834581 None] Create group completed successfully. Nov 05 22:17:05 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-5377d417-65b4-4b5f-af88-14d58118b32c tempest-GroupsV320Test-1963834581 None] Created reservations ['95771130-1a56-48b9-b3da-9f71e393f445'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5377d417-65b4-4b5f-af88-14d58118b32c tempest-GroupsV320Test-1963834581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5377d417-65b4-4b5f-af88-14d58118b32c tempest-GroupsV320Test-1963834581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5377d417-65b4-4b5f-af88-14d58118b32c tempest-GroupsV320Test-1963834581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5377d417-65b4-4b5f-af88-14d58118b32c tempest-GroupsV320Test-1963834581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5377d417-65b4-4b5f-af88-14d58118b32c tempest-GroupsV320Test-1963834581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5377d417-65b4-4b5f-af88-14d58118b32c tempest-GroupsV320Test-1963834581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:05 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:17:05 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:05 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5377d417-65b4-4b5f-af88-14d58118b32c tempest-GroupsV320Test-1963834581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.625s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:05 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-5377d417-65b4-4b5f-af88-14d58118b32c tempest-GroupsV320Test-1963834581 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5377d417-65b4-4b5f-af88-14d58118b32c tempest-GroupsV320Test-1963834581 None] Delete group completed successfully. Nov 05 22:17:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a2ed4c1a-e4da-45fb-af43-c9004801ba21 req-156ee053-ff6f-4c2b-aa3f-1786747e1610 tempest-AttachVolumeShelveTestJSON-1156996809 None] No connector for attachment aff368c8-e02d-4219-9de5-931161c9090e; skipping storage backend terminate_connection call. {{(pid=87122) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 05 22:17:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a2ed4c1a-e4da-45fb-af43-c9004801ba21 req-156ee053-ff6f-4c2b-aa3f-1786747e1610 tempest-AttachVolumeShelveTestJSON-1156996809 None] Deleting attachment aff368c8-e02d-4219-9de5-931161c9090e. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Flow 'volume_create_manager' (f7e9c54b-ccc5-42c2-a8d7-b90a4a6f62f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfec32f-642d-4001-9f5a-5d765157e71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfec32f-642d-4001-9f5a-5d765157e71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1458763924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da28b1f-318c-4cc5-97cb-751833cea1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64ec911b0a64901b64797131e0600e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:18Z,use_quota=True,user_id='c1dbfbf9aa7e4942800b79a12bb2481f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (368dbb03-81b2-41ac-ae31-9186f3b7c2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (368dbb03-81b2-41ac-ae31-9186f3b7c2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77ba201-d9cf-423e-a111-4cd8342206fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77ba201-d9cf-423e-a111-4cd8342206fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da28b1f-318c-4cc5-97cb-751833cea1ac', 'volume_name': 'volume-2da28b1f-318c-4cc5-97cb-751833cea1ac', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b932b9d-ac7a-42ff-8cae-1a815fcf6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b932b9d-ac7a-42ff-8cae-1a815fcf6037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c69167-2a2e-45d6-a341-7b99d0d47251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Volume 2da28b1f-318c-4cc5-97cb-751833cea1ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da28b1f-318c-4cc5-97cb-751833cea1ac', 'volume_size': 1} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1458763924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da28b1f-318c-4cc5-97cb-751833cea1ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64ec911b0a64901b64797131e0600e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:18Z,use_quota=True,user_id='c1dbfbf9aa7e4942800b79a12bb2481f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Creating volume 2da28b1f-318c-4cc5-97cb-751833cea1ac {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:17:18 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:17:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:18 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac 1073741824 Nov 05 22:17:18 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:19 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac 1073741824" returned: 0 in 0.543s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:19 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac Nov 05 22:17:19 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:19 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:17:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c69167-2a2e-45d6-a341-7b99d0d47251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da28b1f-318c-4cc5-97cb-751833cea1ac', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ac832c-40be-47c8-84f8-e77a6fc5b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Volume volume-2da28b1f-318c-4cc5-97cb-751833cea1ac (2da28b1f-318c-4cc5-97cb-751833cea1ac): created successfully Nov 05 22:17:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ac832c-40be-47c8-84f8-e77a6fc5b566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Flow 'volume_create_manager' (f7e9c54b-ccc5-42c2-a8d7-b90a4a6f62f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6147b9ea-898f-480f-b531-3fe3c439f282 tempest-VolumeQuotasAdminTestJSON-1242497820 None] Created volume successfully. Nov 05 22:17:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Acquiring lock "cinder-2da28b1f-318c-4cc5-97cb-751833cea1ac-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "cinder-2da28b1f-318c-4cc5-97cb-751833cea1ac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Acquiring lock "cinder-quobyte-2da28b1f-318c-4cc5-97cb-751833cea1ac" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "cinder-quobyte-2da28b1f-318c-4cc5-97cb-751833cea1ac" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a8c3e4-fa7a-4b85-a705-aa4b2f43617f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:20 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac Nov 05 22:17:20 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:21 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac" returned: 0 in 0.491s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:21 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac Nov 05 22:17:21 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:21 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2da28b1f-318c-4cc5-97cb-751833cea1ac" returned: 0 in 0.311s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "cinder-quobyte-2da28b1f-318c-4cc5-97cb-751833cea1ac" released by "delete_volume" :: held 0.898s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Created reservations ['37ca0a75-7a97-4c7e-bc6c-8d8d6bf4c452', 'fc9f217c-07bf-43fb-a6b6-9cd1349df047', 'eafdb212-83c4-452c-be36-5a246134e34c', 'c759d4dc-ac52-488a-acd1-609cfb49a69c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:21 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:17:21 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:22 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.343s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Deleted volume successfully. Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=96,cinder:UPDATE=120,cinder:INSERT=19,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c43e54fe-b0b9-4605-a8bc-fc3b4edb672a tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "cinder-2da28b1f-318c-4cc5-97cb-751833cea1ac-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=110,cinder:UPDATE=95,cinder:INSERT=32,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Flow 'volume_create_manager' (873d06e9-de9d-423b-b6cb-689e39a41aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21038b03-b6bb-45de-adc0-84b93bb2b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21038b03-b6bb-45de-adc0-84b93bb2b713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-879173578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b212debf-90bf-473c-a0c8-11d39cd36649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64ec911b0a64901b64797131e0600e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:23Z,use_quota=True,user_id='c1dbfbf9aa7e4942800b79a12bb2481f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec27cf9-c04e-4c11-87c8-4622a04f7878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec27cf9-c04e-4c11-87c8-4622a04f7878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19397d0-ee49-4cb9-884c-2736365f137f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19397d0-ee49-4cb9-884c-2736365f137f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b212debf-90bf-473c-a0c8-11d39cd36649', 'volume_name': 'volume-b212debf-90bf-473c-a0c8-11d39cd36649', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00c182f-9172-4ef9-8657-7fc213ec1b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00c182f-9172-4ef9-8657-7fc213ec1b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ac6a91-fefb-426b-9ac0-495096743fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Volume b212debf-90bf-473c-a0c8-11d39cd36649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b212debf-90bf-473c-a0c8-11d39cd36649', 'volume_size': 1} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-879173578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b212debf-90bf-473c-a0c8-11d39cd36649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64ec911b0a64901b64797131e0600e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:23Z,use_quota=True,user_id='c1dbfbf9aa7e4942800b79a12bb2481f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Creating volume b212debf-90bf-473c-a0c8-11d39cd36649 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:17:22 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:17:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:22 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649 1073741824 Nov 05 22:17:22 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:23 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649 1073741824" returned: 0 in 0.578s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:23 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649 Nov 05 22:17:23 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:23 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649" returned: 0 in 0.326s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:17:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ac6a91-fefb-426b-9ac0-495096743fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b212debf-90bf-473c-a0c8-11d39cd36649', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad459475-b29f-447f-be31-12137c1d3794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Volume volume-b212debf-90bf-473c-a0c8-11d39cd36649 (b212debf-90bf-473c-a0c8-11d39cd36649): created successfully Nov 05 22:17:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad459475-b29f-447f-be31-12137c1d3794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Flow 'volume_create_manager' (873d06e9-de9d-423b-b6cb-689e39a41aa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-848b8fe0-62ae-436e-b2de-662da19df12e tempest-VolumeQuotasAdminTestJSON-1242497820 None] Created volume successfully. Nov 05 22:17:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c8f8e0bd-076a-424f-a95b-ea3647c0e1bc tempest-VolumeQuotasAdminTestJSON-48960673 None] Transfer volume completed successfully. Nov 05 22:17:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Acquiring lock "cinder-b212debf-90bf-473c-a0c8-11d39cd36649-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Lock "cinder-b212debf-90bf-473c-a0c8-11d39cd36649-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Acquiring lock "cinder-quobyte-b212debf-90bf-473c-a0c8-11d39cd36649" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Lock "cinder-quobyte-b212debf-90bf-473c-a0c8-11d39cd36649" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[644ade93-f480-47d6-8888-6c00d2147c50]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:28 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649 Nov 05 22:17:28 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:28 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649" returned: 0 in 0.644s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:28 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649 Nov 05 22:17:28 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:29 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b212debf-90bf-473c-a0c8-11d39cd36649" returned: 0 in 0.576s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Lock "cinder-quobyte-b212debf-90bf-473c-a0c8-11d39cd36649" released by "delete_volume" :: held 1.338s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Created reservations ['df94631c-f15a-41b3-aaf1-68e6ff19c925', 'ddf83c7a-a013-4b30-a1a0-5d5cb8f5a2f1', 'e111f80f-2c9d-4330-86a3-0174b7956f33', 'f89f3263-2104-4a53-8500-53e2337cbc40'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:29 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:17:29 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:29 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Deleted volume successfully. Nov 05 22:17:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-19ef0db9-e30c-445d-880f-e80207c7da10 tempest-VolumeQuotasAdminTestJSON-1352805538 None] Lock "cinder-b212debf-90bf-473c-a0c8-11d39cd36649-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-b12368c7-a09a-4f1b-af0a-0d29504370ba req-9c9ff6f5-7020-4549-9314-37b485a6953b tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-b12368c7-a09a-4f1b-af0a-0d29504370ba req-9c9ff6f5-7020-4549-9314-37b485a6953b tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-b12368c7-a09a-4f1b-af0a-0d29504370ba req-9c9ff6f5-7020-4549-9314-37b485a6953b tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-b12368c7-a09a-4f1b-af0a-0d29504370ba req-9c9ff6f5-7020-4549-9314-37b485a6953b tempest-ServerActionsTestOtherA-1281941995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-6d107632-2615-41cb-91f7-ea8061aa2a74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31c4d430-7f1f-4c50-bf17-c1517346881a', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:17:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-b12368c7-a09a-4f1b-af0a-0d29504370ba req-9c9ff6f5-7020-4549-9314-37b485a6953b tempest-ServerActionsTestOtherA-1281941995 None] attachment_update completed successfully. Nov 05 22:17:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-04be476b-bcde-4230-a12b-bf1fa72c5568 req-62656988-d4d4-491e-adbf-b3d12d7758eb tempest-ServerActionsTestOtherA-1281941995 None] Terminate volume connection completed successfully. Nov 05 22:17:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-04be476b-bcde-4230-a12b-bf1fa72c5568 req-62656988-d4d4-491e-adbf-b3d12d7758eb tempest-ServerActionsTestOtherA-1281941995 None] Deleting attachment 31c4d430-7f1f-4c50-bf17-c1517346881a. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:17:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-04be476b-bcde-4230-a12b-bf1fa72c5568 req-d2ce43b1-736f-45cf-9372-5f6a487a91ff tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-04be476b-bcde-4230-a12b-bf1fa72c5568 req-d2ce43b1-736f-45cf-9372-5f6a487a91ff tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-04be476b-bcde-4230-a12b-bf1fa72c5568 req-d2ce43b1-736f-45cf-9372-5f6a487a91ff tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-04be476b-bcde-4230-a12b-bf1fa72c5568 req-d2ce43b1-736f-45cf-9372-5f6a487a91ff tempest-ServerActionsTestOtherA-1281941995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-6d107632-2615-41cb-91f7-ea8061aa2a74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3aa1b91-a3ca-498d-b6a6-8f73c72bd397', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:17:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-04be476b-bcde-4230-a12b-bf1fa72c5568 req-d2ce43b1-736f-45cf-9372-5f6a487a91ff tempest-ServerActionsTestOtherA-1281941995 None] attachment_update completed successfully. Nov 05 22:17:48 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=16,cinder:SELECT=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:17:48 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=27,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:57 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:17:57 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:57 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.305s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 8 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:17:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:17:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Acquiring lock "cinder-2de3e44f-86db-4379-87f3-bb763e93feb9-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Lock "cinder-2de3e44f-86db-4379-87f3-bb763e93feb9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Acquiring lock "cinder-quobyte-2de3e44f-86db-4379-87f3-bb763e93feb9" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Lock "cinder-quobyte-2de3e44f-86db-4379-87f3-bb763e93feb9" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:58 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b35d2-7ab9-4b93-8167-62ad830b1c35]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:58 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9 Nov 05 22:17:58 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:58 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9" returned: 0 in 0.462s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:58 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9 Nov 05 22:17:58 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:59 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2de3e44f-86db-4379-87f3-bb763e93feb9" returned: 0 in 0.300s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Lock "cinder-quobyte-2de3e44f-86db-4379-87f3-bb763e93feb9" released by "delete_volume" :: held 0.824s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Created reservations ['bb66e203-84ed-48bb-aa54-de8e77d7cc96', '6db515c1-a229-46d4-86be-02faca975787', 'cffdb305-df16-457a-8aaa-4a78155661f3', '915c139e-b0d4-49cf-b9e1-2e47c9ed0296'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:59 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:17:59 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:59 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.342s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Deleted volume successfully. Nov 05 22:17:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-29ab5dbd-f66f-44cb-8ca7-104b2184c432 tempest-AttachVolumeShelveTestJSON-1156996809 None] Lock "cinder-2de3e44f-86db-4379-87f3-bb763e93feb9-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-1d39e1bd-3180-4e1a-97a5-39e1154509a0 req-a8f74679-9e94-4cdf-bb9e-b2b4e6e42ccf tempest-ServerActionsTestOtherA-1281941995 None] Terminate volume connection completed successfully. Nov 05 22:18:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-1d39e1bd-3180-4e1a-97a5-39e1154509a0 req-a8f74679-9e94-4cdf-bb9e-b2b4e6e42ccf tempest-ServerActionsTestOtherA-1281941995 None] Deleting attachment e3aa1b91-a3ca-498d-b6a6-8f73c72bd397. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:18:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-76be1951-c035-46e9-87b1-e2fb7a7de845 tempest-GroupSnapshotsV319Test-1752225493 None] Group tempest-GroupSnapshotsV319Test-Group-192606100: creating Nov 05 22:18:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-76be1951-c035-46e9-87b1-e2fb7a7de845 tempest-GroupSnapshotsV319Test-1752225493 None] Group tempest-GroupSnapshotsV319Test-Group-192606100: created successfully Nov 05 22:18:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-76be1951-c035-46e9-87b1-e2fb7a7de845 tempest-GroupSnapshotsV319Test-1752225493 None] Create group completed successfully. Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Flow 'volume_create_manager' (a2ffab82-c2c6-49a2-898f-cd846d7e124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c75b6b0-ccd3-4530-9e74-91b9441eaa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c75b6b0-ccd3-4530-9e74-91b9441eaa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1608411213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4c3f281-c8d0-4b7b-9ed5-7ceda80e9b96,host='devstack@QuobyteHD#QuobyteHD',id=c34ca640-fe1d-48d1-bb27-937ed0c3ab2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d204ad8e9b480da0a24aa53a41ade9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:14Z,use_quota=True,user_id='a8c5e198aa1c46a2bb6c6ffe113aa656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b23d4206-fe8d-4a6f-9b02-8fa490fbe5c0),volume_type_id=b23d4206-fe8d-4a6f-9b02-8fa490fbe5c0)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af71084a-c13d-4857-92c4-9ffd17ca5001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af71084a-c13d-4857-92c4-9ffd17ca5001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c993b36-9e22-423a-ad10-b570e3cdc84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c993b36-9e22-423a-ad10-b570e3cdc84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34ca640-fe1d-48d1-bb27-937ed0c3ab2b', 'volume_name': 'volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11982a8-d572-4e8a-aa40-9dc5bb1380fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11982a8-d572-4e8a-aa40-9dc5bb1380fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b518aa-abc5-43ae-999c-8dd10e8ca3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Volume c34ca640-fe1d-48d1-bb27-937ed0c3ab2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b', 'volume_size': 1} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b4c3f281-c8d0-4b7b-9ed5-7ceda80e9b96,created_at=2026-11-05T21:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1608411213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4c3f281-c8d0-4b7b-9ed5-7ceda80e9b96,host='devstack@QuobyteHD#QuobyteHD',id=c34ca640-fe1d-48d1-bb27-937ed0c3ab2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d204ad8e9b480da0a24aa53a41ade9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:14Z,use_quota=True,user_id='a8c5e198aa1c46a2bb6c6ffe113aa656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b23d4206-fe8d-4a6f-9b02-8fa490fbe5c0),volume_type_id=b23d4206-fe8d-4a6f-9b02-8fa490fbe5c0)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Creating volume c34ca640-fe1d-48d1-bb27-937ed0c3ab2b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:13 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:14 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b 1073741824 Nov 05 22:18:14 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:14 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b 1073741824" returned: 0 in 0.756s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:14 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b Nov 05 22:18:14 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:15 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" returned: 0 in 0.415s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b518aa-abc5-43ae-999c-8dd10e8ca3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cf7e17-2243-47eb-b48f-dd74593767ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Volume volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b (c34ca640-fe1d-48d1-bb27-937ed0c3ab2b): created successfully Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cf7e17-2243-47eb-b48f-dd74593767ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Flow 'volume_create_manager' (a2ffab82-c2c6-49a2-898f-cd846d7e124f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-edf18b2b-7ed8-426a-ade0-5bf875821572 tempest-GroupSnapshotsV319Test-1752225493 None] Created volume successfully. Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Flow 'volume_create_manager' (91936eb4-3166-4ec6-ad4f-bde0ef6e62ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374e6a1c-e994-46b2-8092-e7719d0b1d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374e6a1c-e994-46b2-8092-e7719d0b1d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-885555576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee94390-3809-4223-8a42-0731675a52e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7af98ef324484681227a6cbd79c9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:16Z,use_quota=True,user_id='a4a24b2c959947a1b036e2362b5db4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df83c61c-d491-47de-a55d-496be2e831a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df83c61c-d491-47de-a55d-496be2e831a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfb312c-5b56-4e66-88fe-f553962a3d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:15 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfb312c-5b56-4e66-88fe-f553962a3d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ee94390-3809-4223-8a42-0731675a52e9', 'volume_name': 'volume-4ee94390-3809-4223-8a42-0731675a52e9', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1975ec5c-fce5-45f0-ba61-c52e49839c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1975ec5c-fce5-45f0-ba61-c52e49839c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a31f4-6be0-490c-a61a-c2bd0d0852ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Volume 4ee94390-3809-4223-8a42-0731675a52e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ee94390-3809-4223-8a42-0731675a52e9', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Trying to clone 4ee94390-3809-4223-8a42-0731675a52e9 from image a030b230-32ee-42bd-ba4c-7115346087a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Flow 'volume_create_manager' (6edafe03-cbb1-4122-b5d1-757aae6bb41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a7c2b2-e081-487d-ac15-a7890b6fd253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a7c2b2-e081-487d-ac15-a7890b6fd253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-321907567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95b7521-cf66-4c5c-bc23-b3413e1df64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2327e3bc9a2347b99e373a68457a8bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:16Z,use_quota=True,user_id='6892566974e94afeb82cd4542b1ebd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd9a01c-3fbd-49e1-94cb-f32d1acb1904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd9a01c-3fbd-49e1-94cb-f32d1acb1904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ebd1cb-2cc9-410e-8e75-a38d1ed3f0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:18:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] GroupSnapshot 366155df-da6e-40ed-a7e9-bdb089676ff9: creating. Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Group snapshot 366155df-da6e-40ed-a7e9-bdb089676ff9: creating. {{(pid=87122) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Creating offline snapshot 1c541016-57f3-4d5d-b4bd-f33aaed3cd39 of volume c34ca640-fe1d-48d1-bb27-937ed0c3ab2b {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09fb337-5ed5-4630-ab07-8240dc939775]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:18:16 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Image download 20.69 MB at 20.69 MB/s Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ebd1cb-2cc9-410e-8e75-a38d1ed3f0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b95b7521-cf66-4c5c-bc23-b3413e1df64b', 'volume_name': 'volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936cf6fd-8c7b-4cab-aeab-effbb6f20bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936cf6fd-8c7b-4cab-aeab-effbb6f20bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa28533c-b05e-4194-8cd0-34b46739fc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Volume b95b7521-cf66-4c5c-bc23-b3413e1df64b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Trying to clone b95b7521-cf66-4c5c-bc23-b3413e1df64b from image a030b230-32ee-42bd-ba4c-7115346087a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:18:17 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b Nov 05 22:18:17 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[15825231-077c-47d1-9813-9e7cafe18325]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:17 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD Nov 05 22:18:17 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:18:17 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Image download 20.69 MB at 20.69 MB/s Nov 05 22:18:17 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" returned: 0 in 0.535s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:17 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 1G Nov 05 22:18:17 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7229508b-a133-4408-a366-0c1b79b1d169]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:17 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Temporary image a030b230-32ee-42bd-ba4c-7115346087a9 is fetched for user a4a24b2c959947a1b036e2362b5db4bc. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:18:17 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD Nov 05 22:18:17 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d59cea4-6c2a-45ff-9a0d-b178512737fa]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:17 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD Nov 05 22:18:17 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:17 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:17 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Temporary image a030b230-32ee-42bd-ba4c-7115346087a9 is fetched for user 6892566974e94afeb82cd4542b1ebd4f. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:18:18 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 1G" returned: 0 in 0.566s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:18 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 Nov 05 22:18:18 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[022db4f2-d507-43be-a1a3-855274d7a980]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:18 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:18 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD Nov 05 22:18:18 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:18 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39" returned: 0 in 0.501s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:18 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:18 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 Nov 05 22:18:18 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:18 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD" returned: 0 in 0.616s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:18 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:19 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.info Nov 05 22:18:19 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:19 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.info" returned: 0 in 0.378s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:19 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:19 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.info Nov 05 22:18:19 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:19 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.info" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.790s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-885555576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee94390-3809-4223-8a42-0731675a52e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7af98ef324484681227a6cbd79c9da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:16Z,use_quota=True,user_id='a4a24b2c959947a1b036e2362b5db4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Creating volume 4ee94390-3809-4223-8a42-0731675a52e9 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:19 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:19 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 1073741824 Nov 05 22:18:19 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2164bfd2-3b08-4042-bfaf-5fc53218db30 tempest-GroupSnapshotsV319Test-1752225493 None] group_snapshot 366155df-da6e-40ed-a7e9-bdb089676ff9: created successfully Nov 05 22:18:20 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 1073741824" returned: 0 in 0.631s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:20 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 Nov 05 22:18:20 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:20 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9" returned: 0 in 0.306s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.895s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-321907567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95b7521-cf66-4c5c-bc23-b3413e1df64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2327e3bc9a2347b99e373a68457a8bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:16Z,use_quota=True,user_id='6892566974e94afeb82cd4542b1ebd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Creating volume b95b7521-cf66-4c5c-bc23-b3413e1df64b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:20 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:20 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b 1073741824 Nov 05 22:18:20 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] group_snapshot 366155df-da6e-40ed-a7e9-bdb089676ff9: deleting Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Attempting download of a030b230-32ee-42bd-ba4c-7115346087a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}])) to volume 4ee94390-3809-4223-8a42-0731675a52e9. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] group_snapshot 366155df-da6e-40ed-a7e9-bdb089676ff9: deleting {{(pid=87122) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[11317a1c-6f9a-443d-a0b2-b85c83203818]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_mp6alexa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Acquiring lock "cinder-quobyte-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Lock "cinder-quobyte-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Acquiring lock "cinder-quobyte-1c541016-57f3-4d5d-b4bd-f33aaed3cd39" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Lock "cinder-quobyte-1c541016-57f3-4d5d-b4bd-f33aaed3cd39" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Deleting offline snapshot 1c541016-57f3-4d5d-b4bd-f33aaed3cd39 of volume c34ca640-fe1d-48d1-bb27-937ed0c3ab2b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:18:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] snapshot_file for this snap is: volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:18:21 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29fa9c5-6f84-4668-b5fa-a2620cdf3e8c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:21 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_mp6alexa Nov 05 22:18:21 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:21 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 Nov 05 22:18:21 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:21 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b 1073741824" returned: 0 in 0.750s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:21 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_mp6alexa" returned: 0 in 0.563s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_mp6alexa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:21 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b Nov 05 22:18:21 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:21 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_mp6alexa Nov 05 22:18:21 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:22 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:22 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39" returned: 0 in 0.925s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:18:22 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94949318-4856-4683-a76f-8f2c5c069884]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b" returned: 0 in 0.568s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_mp6alexa" returned: 1 in 0.603s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_mp6alexa' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[357872e5-fe39-4a91-967d-808027988e2d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (3efbd930-209b-49c2-9bac-1c9226aab5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6800f6-8019-4b20-a309-07cd3650f662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Attempting download of a030b230-32ee-42bd-ba4c-7115346087a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}])) to volume b95b7521-cf66-4c5c-bc23-b3413e1df64b. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:18:22 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b Nov 05 22:18:22 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6800f6-8019-4b20-a309-07cd3650f662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1384485393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a97af2-cf20-4090-8130-04f9a1de78d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:22Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d265d1-4ac8-4d4d-ac73-8583cc7236bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d265d1-4ac8-4d4d-ac73-8583cc7236bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603c0d80-dcb9-4e22-a8e4-b1013aee1494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603c0d80-dcb9-4e22-a8e4-b1013aee1494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a97af2-cf20-4090-8130-04f9a1de78d3', 'volume_name': 'volume-69a97af2-cf20-4090-8130-04f9a1de78d3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba836338-8fe4-4e2b-ba8e-5b0ed300d6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba836338-8fe4-4e2b-ba8e-5b0ed300d6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621720ca-5f49-4f8c-9126-38c1e7e546b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Volume 69a97af2-cf20-4090-8130-04f9a1de78d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a97af2-cf20-4090-8130-04f9a1de78d3', 'volume_size': 1} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1384485393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a97af2-cf20-4090-8130-04f9a1de78d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:22Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Creating volume 69a97af2-cf20-4090-8130-04f9a1de78d3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:22 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:22 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD Nov 05 22:18:22 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5374c34-447b-4da2-992c-2103d67f1751]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_142_4ern {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:22 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3 1073741824 Nov 05 22:18:22 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:22 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_142_4ern Nov 05 22:18:22 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:22 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:22 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] a030b230-32ee-42bd-ba4c-7115346087a9 was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" returned: 0 in 0.553s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:22 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 Nov 05 22:18:22 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:22 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 Nov 05 22:18:22 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:22 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_142_4ern" returned: 0 in 0.615s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_142_4ern {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:23 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3 1073741824" returned: 0 in 0.754s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:23 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3 Nov 05 22:18:23 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:23 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_142_4ern Nov 05 22:18:23 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:23 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39" returned: 0 in 0.568s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:23 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39 Nov 05 22:18:23 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:23 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3" returned: 0 in 0.352s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:23 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_142_4ern" returned: 1 in 0.485s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_142_4ern' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9436f165-e10b-4f5a-8616-8406afaba895]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621720ca-5f49-4f8c-9126-38c1e7e546b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a97af2-cf20-4090-8130-04f9a1de78d3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db57060a-d8e0-4c82-89a6-1d9e930f64fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Volume volume-69a97af2-cf20-4090-8130-04f9a1de78d3 (69a97af2-cf20-4090-8130-04f9a1de78d3): created successfully Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db57060a-d8e0-4c82-89a6-1d9e930f64fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (3efbd930-209b-49c2-9bac-1c9226aab5ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3bfbaed1-11cb-4d02-a7da-89d124154d7f tempest-VolumesActionsTest-1086408705 None] Created volume successfully. Nov 05 22:18:23 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b.1c541016-57f3-4d5d-b4bd-f33aaed3cd39" returned: 0 in 0.437s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:23 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD Nov 05 22:18:23 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Lock "cinder-quobyte-1c541016-57f3-4d5d-b4bd-f33aaed3cd39" released by "_delete_snapshot" :: held 2.655s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Lock "cinder-quobyte-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" released by "delete_snapshot" :: held 2.696s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:23 devstack cinder-volume[87122]: WARNING cinder.quota [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1327902943 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1327902943, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:18:23 devstack cinder-volume[87122]: WARNING cinder.quota [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1327902943 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1327902943, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] Created reservations ['1e4fdf27-dc80-41d4-b120-4c61a0568c55', 'af4dce19-31ad-44c3-b6b7-7f15a1223dbe', 'dc77ae39-29cd-4fbb-8540-446aef7b899c', '036ef334-f4d8-4c1e-89ce-dac37064ac76'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-25b82f76-51e9-4e83-a5a4-8cec64e7ec48 tempest-GroupSnapshotsV319Test-1752225493 None] group_snapshot 366155df-da6e-40ed-a7e9-bdb089676ff9: deleted successfully Nov 05 22:18:23 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:23 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] a030b230-32ee-42bd-ba4c-7115346087a9 was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:18:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:24 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b Nov 05 22:18:24 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0ee43bce-fb76-4b0a-b385-81889436f9d0 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3" by "attach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0ee43bce-fb76-4b0a-b385-81889436f9d0 tempest-VolumesActionsTest-1086408705 None] Lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3" acquired by "attach_volume" :: waited 0.048s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0ee43bce-fb76-4b0a-b385-81889436f9d0 tempest-VolumesActionsTest-1086408705 None] Attaching volume 69a97af2-cf20-4090-8130-04f9a1de78d3 to instance 5024acef-c230-495a-bd6d-4d8f541c60d2 at mountpoint /dev/vdb on host None. Nov 05 22:18:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0ee43bce-fb76-4b0a-b385-81889436f9d0 tempest-VolumesActionsTest-1086408705 None] Attach volume completed successfully. Nov 05 22:18:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0ee43bce-fb76-4b0a-b385-81889436f9d0 tempest-VolumesActionsTest-1086408705 None] Lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3" released by "attach_volume" :: held 0.139s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Acquiring lock "cinder-quobyte-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Lock "cinder-quobyte-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aade1a-5f33-4e96-98a5-11e90dbd2adf]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:25 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b Nov 05 22:18:25 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3a632263-fdd6-466f-84a6-68a156606a75 tempest-VolumesActionsTest-666815607 None] Terminate volume connection completed successfully. Nov 05 22:18:25 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9" returned: 0 in 2.800s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_alnaj2ghdevstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:18:25 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Converted 112.00 MB image at 39.97 MB/s Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:25 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 1G Nov 05 22:18:25 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3a632263-fdd6-466f-84a6-68a156606a75 tempest-VolumesActionsTest-666815607 None] Acquiring lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3-detach_volume" by "detach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3a632263-fdd6-466f-84a6-68a156606a75 tempest-VolumesActionsTest-666815607 None] Lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3a632263-fdd6-466f-84a6-68a156606a75 tempest-VolumesActionsTest-666815607 None] Detaching volume 69a97af2-cf20-4090-8130-04f9a1de78d3 from instance 5024acef-c230-495a-bd6d-4d8f541c60d2. Nov 05 22:18:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3a632263-fdd6-466f-84a6-68a156606a75 tempest-VolumesActionsTest-666815607 None] Detach volume completed successfully. Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3a632263-fdd6-466f-84a6-68a156606a75 tempest-VolumesActionsTest-666815607 None] Lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:25 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" returned: 0 in 0.781s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:25 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b Nov 05 22:18:25 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ce0c051-4036-4b26-913a-5f0ccc784f87 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3-detach_volume" by "detach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:25 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ce0c051-4036-4b26-913a-5f0ccc784f87 tempest-VolumesActionsTest-1086408705 None] Lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9ce0c051-4036-4b26-913a-5f0ccc784f87 tempest-VolumesActionsTest-1086408705 None] Volume detach called, but volume not attached. Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 1G" returned: 0 in 0.561s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Downloaded image a030b230-32ee-42bd-ba4c-7115346087a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}])) to volume 4ee94390-3809-4223-8a42-0731675a52e9 successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Temporary image a030b230-32ee-42bd-ba4c-7115346087a9 for user a4a24b2c959947a1b036e2362b5db4bc is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:18:25 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Marking volume 4ee94390-3809-4223-8a42-0731675a52e9 as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Copying metadata from image a030b230-32ee-42bd-ba4c-7115346087a9 to 4ee94390-3809-4223-8a42-0731675a52e9. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Creating volume glance metadata for volume 4ee94390-3809-4223-8a42-0731675a52e9 backed by image a030b230-32ee-42bd-ba4c-7115346087a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ce0c051-4036-4b26-913a-5f0ccc784f87 tempest-VolumesActionsTest-1086408705 None] Lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a31f4-6be0-490c-a61a-c2bd0d0852ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee94390-3809-4223-8a42-0731675a52e9', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1991c556-09f9-4e0b-b7b2-8dc36eb640b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Volume volume-4ee94390-3809-4223-8a42-0731675a52e9 (4ee94390-3809-4223-8a42-0731675a52e9): created successfully Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1991c556-09f9-4e0b-b7b2-8dc36eb640b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Flow 'volume_create_manager' (91936eb4-3166-4ec6-ad4f-bde0ef6e62ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-27083df1-30a2-4389-b991-1ef1b6935765 tempest-VolumesImageMetadata-1191673804 None] Created volume successfully. Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" returned: 0 in 0.561s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:26 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Lock "cinder-quobyte-c34ca640-fe1d-48d1-bb27-937ed0c3ab2b" released by "delete_volume" :: held 1.468s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Acquiring lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Created reservations ['7e7139dc-4535-4645-a219-cce038c002b9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Acquiring lock "cinder-quobyte-69a97af2-cf20-4090-8130-04f9a1de78d3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:26 devstack cinder-volume[87122]: WARNING cinder.quota [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1327902943 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1327902943, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Lock "cinder-quobyte-69a97af2-cf20-4090-8130-04f9a1de78d3" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Created reservations ['fafccee5-5709-4481-8c00-67d824a16c85', 'c3904868-683f-4a36-b86a-ec155edb05a4', '191f718b-d6ed-4e74-91f3-3988cee549f4', 'fda08110-5c35-4710-b931-263d5c4474b0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff65b26-1c09-4f34-945f-aefe75a213a6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:26 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3 Nov 05 22:18:26 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:26 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:18:26 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:26 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b" returned: 0 in 2.892s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_8f45ot9udevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:18:26 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Converted 112.00 MB image at 38.69 MB/s Nov 05 22:18:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:26 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b 1G Nov 05 22:18:26 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:27 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.380s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-69f02bb1-ef2b-484c-be4c-578d1dbcd78a tempest-GroupSnapshotsV319Test-1752225493 None] Delete group completed successfully. Nov 05 22:18:27 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3" returned: 0 in 0.576s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:27 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3 Nov 05 22:18:27 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:27 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b 1G" returned: 0 in 0.563s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Downloaded image a030b230-32ee-42bd-ba4c-7115346087a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}])) to volume b95b7521-cf66-4c5c-bc23-b3413e1df64b successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Temporary image a030b230-32ee-42bd-ba4c-7115346087a9 for user 6892566974e94afeb82cd4542b1ebd4f is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Marking volume b95b7521-cf66-4c5c-bc23-b3413e1df64b as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Copying metadata from image a030b230-32ee-42bd-ba4c-7115346087a9 to b95b7521-cf66-4c5c-bc23-b3413e1df64b. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Creating volume glance metadata for volume b95b7521-cf66-4c5c-bc23-b3413e1df64b backed by image a030b230-32ee-42bd-ba4c-7115346087a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:18:27 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69a97af2-cf20-4090-8130-04f9a1de78d3" returned: 0 in 0.373s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Lock "cinder-quobyte-69a97af2-cf20-4090-8130-04f9a1de78d3" released by "delete_volume" :: held 1.007s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa28533c-b05e-4194-8cd0-34b46739fc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a578c4-91ce-4008-823b-6d00b382f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:27 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Volume volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b (b95b7521-cf66-4c5c-bc23-b3413e1df64b): created successfully Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a578c4-91ce-4008-823b-6d00b382f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Flow 'volume_create_manager' (6edafe03-cbb1-4122-b5d1-757aae6bb41d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Created reservations ['c66ddbbd-4a02-4f7d-9d34-5404e685c8e0', 'e68320e4-46ab-4555-accd-2abcf85141de', 'd0c1ff53-11ed-417c-abea-8023e3676eb2', '1f180b1e-4a5a-4725-9a6d-fc03b68ec50d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f4d4f722-fedd-465b-bd09-a7bdd3532199 tempest-ServerActionsTestOtherA-1281941995 None] Created volume successfully. Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:27 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:18:27 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Acquiring lock "cinder-4ee94390-3809-4223-8a42-0731675a52e9-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Lock "cinder-4ee94390-3809-4223-8a42-0731675a52e9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Acquiring lock "cinder-quobyte-4ee94390-3809-4223-8a42-0731675a52e9" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Lock "cinder-quobyte-4ee94390-3809-4223-8a42-0731675a52e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c164aa1-a3fd-4cd0-957d-889024c281a3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:28 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.360s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:28 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 Nov 05 22:18:28 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Deleted volume successfully. Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e1b743bf-3933-46ec-80ba-8f4769a3186a tempest-VolumesActionsTest-1086408705 None] Lock "cinder-69a97af2-cf20-4090-8130-04f9a1de78d3-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:28 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9" returned: 0 in 0.454s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:28 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9 Nov 05 22:18:28 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:28 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4ee94390-3809-4223-8a42-0731675a52e9" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Lock "cinder-quobyte-4ee94390-3809-4223-8a42-0731675a52e9" released by "delete_volume" :: held 0.855s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:29 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Created reservations ['e1523388-f820-473c-b988-ec990b8bb084', '0ba4a631-78c1-4852-b1ea-198220bb02ac', '9c0e24db-352d-42b6-b245-47e47932a0c2', 'a46201af-11a7-4bd9-8483-706320c4f78f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:29 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:18:29 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:29 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:29 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Deleted volume successfully. Nov 05 22:18:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d9fa2927-ac93-4d20-bd47-0474dde2666d tempest-VolumesImageMetadata-1191673804 None] Lock "cinder-4ee94390-3809-4223-8a42-0731675a52e9-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (a40ac18a-8094-416d-9913-6959ac8938d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4838d4-322f-4634-b581-0a70c9e2ed45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4838d4-322f-4634-b581-0a70c9e2ed45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107079322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ba094b-6fd2-49a3-bca7-a0bfe6251dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:33Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3733c2-832c-4ae6-8758-994c9ca4d95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a3733c2-832c-4ae6-8758-994c9ca4d95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edc98f6-acb8-4630-b55d-b182e1d3b94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edc98f6-acb8-4630-b55d-b182e1d3b94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ba094b-6fd2-49a3-bca7-a0bfe6251dab', 'volume_name': 'volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd23add-af4b-4e05-bc24-eed619b78e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd23add-af4b-4e05-bc24-eed619b78e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b138328-008f-4300-949e-5bd399c5a1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Volume 12ba094b-6fd2-49a3-bca7-a0bfe6251dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab', 'volume_size': 1} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107079322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ba094b-6fd2-49a3-bca7-a0bfe6251dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:33Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Creating volume 12ba094b-6fd2-49a3-bca7-a0bfe6251dab {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:33 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:33 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab 1073741824 Nov 05 22:18:33 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5b2d6b30-c4fb-414a-abd4-d8711fe64b63 req-803c669c-1b36-4663-aef3-3dcb1c664d3b tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:33 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab 1073741824" returned: 0 in 0.706s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:33 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab Nov 05 22:18:33 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:34 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5b2d6b30-c4fb-414a-abd4-d8711fe64b63 req-803c669c-1b36-4663-aef3-3dcb1c664d3b tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.585s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b138328-008f-4300-949e-5bd399c5a1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60525397-2bb9-4829-ab48-cd8d85dd2f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5b2d6b30-c4fb-414a-abd4-d8711fe64b63 req-803c669c-1b36-4663-aef3-3dcb1c664d3b tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:34 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Volume volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab (12ba094b-6fd2-49a3-bca7-a0bfe6251dab): created successfully Nov 05 22:18:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60525397-2bb9-4829-ab48-cd8d85dd2f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (a40ac18a-8094-416d-9913-6959ac8938d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-5b2d6b30-c4fb-414a-abd4-d8711fe64b63 req-803c669c-1b36-4663-aef3-3dcb1c664d3b tempest-ServerActionsTestOtherA-1281941995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c093870-5801-4b53-9bd6-1a945b522332', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:18:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-badf1b4a-563a-4485-b536-a4fe2901a47b tempest-VolumesActionsTest-1086408705 None] Created volume successfully. Nov 05 22:18:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-5b2d6b30-c4fb-414a-abd4-d8711fe64b63 req-803c669c-1b36-4663-aef3-3dcb1c664d3b tempest-ServerActionsTestOtherA-1281941995 None] attachment_update completed successfully. Nov 05 22:18:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Acquiring lock "cinder-12ba094b-6fd2-49a3-bca7-a0bfe6251dab-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Lock "cinder-12ba094b-6fd2-49a3-bca7-a0bfe6251dab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Acquiring lock "cinder-quobyte-12ba094b-6fd2-49a3-bca7-a0bfe6251dab" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Lock "cinder-quobyte-12ba094b-6fd2-49a3-bca7-a0bfe6251dab" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[723d5fd3-07b1-4e0f-bb5f-6d726380b470]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:35 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab Nov 05 22:18:35 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:36 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab" returned: 0 in 0.520s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:36 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab Nov 05 22:18:36 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:36 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-12ba094b-6fd2-49a3-bca7-a0bfe6251dab" returned: 0 in 0.458s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Lock "cinder-quobyte-12ba094b-6fd2-49a3-bca7-a0bfe6251dab" released by "delete_volume" :: held 1.061s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Created reservations ['8fd6797b-baf2-435b-9070-907be9fdf818', '22c0b8a1-4c2b-4705-9346-7fbaea102b24', '49da9c0c-6fa4-4e2f-8015-d1953d5f22f9', 'e841d337-98ce-46e0-8622-d14bb0f97b48'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:36 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:18:36 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:37 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.603s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:37 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Deleted volume successfully. Nov 05 22:18:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-75717957-f249-4442-989c-d9fcdf583e18 tempest-VolumesActionsTest-666815607 None] Lock "cinder-12ba094b-6fd2-49a3-bca7-a0bfe6251dab-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (c94ae274-b3dd-42ca-8d34-cee644429518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74453096-cd7f-40db-859e-915b3ba9cc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74453096-cd7f-40db-859e-915b3ba9cc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-606537833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4f9c34-8335-4ae2-b33a-1a2961613df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:39Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb041e03-3c7d-4075-9d96-0d166d054ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb041e03-3c7d-4075-9d96-0d166d054ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804a5887-24fc-4692-90dc-f3f2478896f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (804a5887-24fc-4692-90dc-f3f2478896f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d4f9c34-8335-4ae2-b33a-1a2961613df1', 'volume_name': 'volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d60077-9993-440c-9916-80bf94622987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d60077-9993-440c-9916-80bf94622987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fff4ca-7bc1-4b4c-bc9c-bc4b73706dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Volume 3d4f9c34-8335-4ae2-b33a-1a2961613df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1', 'volume_size': 1} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-606537833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4f9c34-8335-4ae2-b33a-1a2961613df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:39Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Creating volume 3d4f9c34-8335-4ae2-b33a-1a2961613df1 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:38 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:38 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1 1073741824 Nov 05 22:18:38 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Flow 'volume_create_manager' (943b1264-61e6-4980-859d-f0b2c73ab259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbab14f-28cd-47ce-83c1-6cf0b368fc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbab14f-28cd-47ce-83c1-6cf0b368fc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-122456248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f5d1abe0a045a9b6511653d939af7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:39Z,use_quota=True,user_id='ad4878d0360d4b1487abeb8cb31520e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa3fc59-7447-44e6-b84c-32d8a5e8032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa3fc59-7447-44e6-b84c-32d8a5e8032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8fe379-6bb2-4327-bcd3-a70bb631de0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8fe379-6bb2-4327-bcd3-a70bb631de0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63', 'volume_name': 'volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b9168f-4fda-4c4e-a345-12a166e61794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b9168f-4fda-4c4e-a345-12a166e61794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a264efa5-9ce4-4431-ab06-c745619c0bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Volume cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63', 'volume_size': 1} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:39 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1 1073741824" returned: 0 in 0.715s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:39 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1 Nov 05 22:18:39 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:39 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1" returned: 0 in 0.310s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-122456248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f5d1abe0a045a9b6511653d939af7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:39Z,use_quota=True,user_id='ad4878d0360d4b1487abeb8cb31520e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Creating volume cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fff4ca-7bc1-4b4c-bc9c-bc4b73706dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:40 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 1073741824 Nov 05 22:18:40 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a69b81-7066-43c5-a02f-7c817e645f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Volume volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1 (3d4f9c34-8335-4ae2-b33a-1a2961613df1): created successfully Nov 05 22:18:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a69b81-7066-43c5-a02f-7c817e645f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (c94ae274-b3dd-42ca-8d34-cee644429518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b93377f7-8e51-43a7-a96d-a71a25c2b4c8 tempest-VolumesActionsTest-1086408705 None] Created volume successfully. Nov 05 22:18:40 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 1073741824" returned: 0 in 0.510s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:40 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 Nov 05 22:18:40 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:41 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63" returned: 0 in 0.505s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Acquiring lock "cinder-3d4f9c34-8335-4ae2-b33a-1a2961613df1-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a264efa5-9ce4-4431-ab06-c745619c0bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a021e201-0e12-43d5-a825-2427f6cbe7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Lock "cinder-3d4f9c34-8335-4ae2-b33a-1a2961613df1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Volume volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 (cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63): created successfully Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a021e201-0e12-43d5-a825-2427f6cbe7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Flow 'volume_create_manager' (943b1264-61e6-4980-859d-f0b2c73ab259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ea2a91ad-0358-4019-b5b7-7d4a8824b75e tempest-VolumesTransfersTest-1255618851 None] Created volume successfully. Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Acquiring lock "cinder-quobyte-3d4f9c34-8335-4ae2-b33a-1a2961613df1" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Lock "cinder-quobyte-3d4f9c34-8335-4ae2-b33a-1a2961613df1" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9561bda7-b293-439e-98b9-103ede17d6c9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:41 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1 Nov 05 22:18:41 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:41 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1" returned: 0 in 0.562s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:41 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1 Nov 05 22:18:41 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:42 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3d4f9c34-8335-4ae2-b33a-1a2961613df1" returned: 0 in 0.643s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Lock "cinder-quobyte-3d4f9c34-8335-4ae2-b33a-1a2961613df1" released by "delete_volume" :: held 1.299s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:42 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Created reservations ['784e283a-01b5-4da2-989a-15850b8ee6a3', '58b1013c-bc44-42f6-b747-b1edcd979d99', 'acf4d61d-0ec9-4642-9eec-f9740eed082e', 'c47bd665-7108-4dd2-8f0d-bb30c96e3eb9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:42 devstack sudo[93444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:18:42 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:43 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.915s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:43 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Deleted volume successfully. Nov 05 22:18:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8214cd9-e72f-4189-8a28-0735d99bffe0 tempest-VolumesActionsTest-666815607 None] Lock "cinder-3d4f9c34-8335-4ae2-b33a-1a2961613df1-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c4f1496c-3043-4dcb-b33b-98cd81678125 tempest-VolumesTransfersTest-1084411106 None] Transfer volume completed successfully. Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (e1bf2d61-9880-4062-a7bd-14953e2bc096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ba5168-4598-43db-b380-d2abcc3f17f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ba5168-4598-43db-b380-d2abcc3f17f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107294405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbf3e6b-366b-4c5f-96d3-da76a6825d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:45Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4caf8a75-0d60-4175-bbc7-b8c4d5e4cd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4caf8a75-0d60-4175-bbc7-b8c4d5e4cd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab97601-e0f6-4a4f-b17c-dd2ca6df99cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab97601-e0f6-4a4f-b17c-dd2ca6df99cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cbf3e6b-366b-4c5f-96d3-da76a6825d2b', 'volume_name': 'volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ed3299-e938-4115-9b9c-a097b86e492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ed3299-e938-4115-9b9c-a097b86e492f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20dcd198-dbdf-4246-bd59-f1841b36a0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:45 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Volume 1cbf3e6b-366b-4c5f-96d3-da76a6825d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b', 'volume_size': 1} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107294405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbf3e6b-366b-4c5f-96d3-da76a6825d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:45Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Creating volume 1cbf3e6b-366b-4c5f-96d3-da76a6825d2b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:45 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:45 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b 1073741824 Nov 05 22:18:45 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Acquiring lock "cinder-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Lock "cinder-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:46 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b 1073741824" returned: 0 in 0.965s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Acquiring lock "cinder-quobyte-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Lock "cinder-quobyte-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63" acquired by "delete_volume" :: waited 0.049s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[593d83e7-d2a0-422d-a6ea-977d9939ed92]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:46 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b Nov 05 22:18:46 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:46 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 Nov 05 22:18:46 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:46 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b" returned: 0 in 0.495s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20dcd198-dbdf-4246-bd59-f1841b36a0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d890dbd-2100-41d6-bb9d-ec19ebbeddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Volume volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b (1cbf3e6b-366b-4c5f-96d3-da76a6825d2b): created successfully Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d890dbd-2100-41d6-bb9d-ec19ebbeddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (e1bf2d61-9880-4062-a7bd-14953e2bc096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8e4e1d93-7f9c-49e9-bdfc-c9325f79fb90 tempest-VolumesActionsTest-1086408705 None] Created volume successfully. Nov 05 22:18:47 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63" returned: 0 in 0.813s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:47 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63 Nov 05 22:18:47 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63" returned: 0 in 0.476s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:47 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Lock "cinder-quobyte-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63" released by "delete_volume" :: held 1.371s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Created reservations ['868de39f-e20b-4e72-8f20-414a11239de2', '99457e23-8780-49fb-a164-ae412850da02', 'ed6cd4b8-3c0a-4298-b851-c2f0f6d0961c', '5ab7ef54-b52d-45d3-9169-6a4f20c4de5b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:47 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:18:47 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:48 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.476s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:48 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Deleted volume successfully. Nov 05 22:18:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Acquiring lock "cinder-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Lock "cinder-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5dd2752d-9f3f-45d7-9668-ac829dce7fd2 tempest-VolumesTransfersTest-1799050084 None] Lock "cinder-cbf5670f-4b2e-4f3e-9d98-adbe70e1ee63-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Acquiring lock "cinder-quobyte-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Lock "cinder-quobyte-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd974891-9a0f-48fc-a593-20e43ede8f98]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:48 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b Nov 05 22:18:48 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:49 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b" returned: 0 in 0.479s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:49 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b Nov 05 22:18:49 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:49 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b" returned: 0 in 0.408s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Lock "cinder-quobyte-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b" released by "delete_volume" :: held 0.951s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=114,cinder:SELECT=98,cinder:INSERT=38,cinder:DELETE=6 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=105,cinder:INSERT=32,cinder:UPDATE=88,cinder:DELETE=8 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Created reservations ['04183452-a63b-42dd-baab-47c0b0155e9c', '3dcce9d7-ad94-4d76-abe4-6423b0b6afde', '9769d856-e623-465d-b772-f4353a779e75', '3279daf3-f05c-4d49-a47a-1d59f5dbbfbd'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Flow 'volume_create_manager' (b443da67-fdd6-4397-921d-3c3a1dd4b1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ec57c8-b5e1-422d-aaa6-ade5edb84edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ec57c8-b5e1-422d-aaa6-ade5edb84edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-553623490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a698be-af4f-4bd4-b7b9-ee2a257dc4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f5d1abe0a045a9b6511653d939af7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:50Z,use_quota=True,user_id='ad4878d0360d4b1487abeb8cb31520e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2475f53-b474-4345-950c-b0b03216c78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2475f53-b474-4345-950c-b0b03216c78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622f94fd-d117-49f9-a473-0ce2e86689df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622f94fd-d117-49f9-a473-0ce2e86689df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a698be-af4f-4bd4-b7b9-ee2a257dc4cb', 'volume_name': 'volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f1daae-7011-4945-9e2d-65e04701889d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f1daae-7011-4945-9e2d-65e04701889d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8839cc7-2b49-4881-82ef-87ca78a9cd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:49 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Volume 77a698be-af4f-4bd4-b7b9-ee2a257dc4cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb', 'volume_size': 1} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-553623490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a698be-af4f-4bd4-b7b9-ee2a257dc4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58f5d1abe0a045a9b6511653d939af7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:50Z,use_quota=True,user_id='ad4878d0360d4b1487abeb8cb31520e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Creating volume 77a698be-af4f-4bd4-b7b9-ee2a257dc4cb {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:49 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:49 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb 1073741824 Nov 05 22:18:49 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:50 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:18:50 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:50 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.679s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:50 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Deleted volume successfully. Nov 05 22:18:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-44957fe4-061c-45ff-8bbf-b340491b9570 tempest-VolumesActionsTest-666815607 None] Lock "cinder-1cbf3e6b-366b-4c5f-96d3-da76a6825d2b-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:50 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb 1073741824" returned: 0 in 0.871s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:50 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb Nov 05 22:18:50 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:51 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8839cc7-2b49-4881-82ef-87ca78a9cd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7b350e-035f-4bb6-93a4-2a78b4964140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:51 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Volume volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb (77a698be-af4f-4bd4-b7b9-ee2a257dc4cb): created successfully Nov 05 22:18:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7b350e-035f-4bb6-93a4-2a78b4964140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Flow 'volume_create_manager' (b443da67-fdd6-4397-921d-3c3a1dd4b1e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4a80b675-f633-4a98-a284-2a42354fb4d8 tempest-VolumesTransfersTest-1255618851 None] Created volume successfully. Nov 05 22:18:51 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (d528e35f-78b5-46d1-b19c-6d40e6b883ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204f4026-3049-4ac6-b757-ad95ce6360b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204f4026-3049-4ac6-b757-ad95ce6360b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1327316140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0226d115-0796-44b2-a03f-250d65f4b156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:52Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bde43e-ec0e-42a4-be82-c3707c408ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bde43e-ec0e-42a4-be82-c3707c408ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d48df89-402d-4327-82fe-3b94df8e609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d48df89-402d-4327-82fe-3b94df8e609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0226d115-0796-44b2-a03f-250d65f4b156', 'volume_name': 'volume-0226d115-0796-44b2-a03f-250d65f4b156', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0ec7fd-c5d1-4256-a71b-0b3feb8c3dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0ec7fd-c5d1-4256-a71b-0b3feb8c3dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d087f3-67d6-4de1-88e4-e160da25a220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:52 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Volume 0226d115-0796-44b2-a03f-250d65f4b156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0226d115-0796-44b2-a03f-250d65f4b156', 'volume_size': 1} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1327316140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0226d115-0796-44b2-a03f-250d65f4b156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:52Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Creating volume 0226d115-0796-44b2-a03f-250d65f4b156 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:52 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:52 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156 1073741824 Nov 05 22:18:52 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Acquiring lock "cinder-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Lock "cinder-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Acquiring lock "cinder-quobyte-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Lock "cinder-quobyte-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb" acquired by "delete_volume" :: waited 0.041s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541bed8-9f6f-40ca-b5e3-3d58f4ad24a2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:52 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb Nov 05 22:18:52 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:53 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156 1073741824" returned: 0 in 0.963s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-b4eb380c-308c-47fc-a212-0fce291d7bcf req-b323ecab-c714-429b-b74a-0c1b9c162502 tempest-ServerActionsTestOtherA-1281941995 None] Terminate volume connection completed successfully. Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-b4eb380c-308c-47fc-a212-0fce291d7bcf req-b323ecab-c714-429b-b74a-0c1b9c162502 tempest-ServerActionsTestOtherA-1281941995 None] Deleting attachment 9c093870-5801-4b53-9bd6-1a945b522332. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:53 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156 Nov 05 22:18:53 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:53 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb" returned: 0 in 0.570s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:53 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb Nov 05 22:18:53 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:53 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156" returned: 0 in 0.319s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d087f3-67d6-4de1-88e4-e160da25a220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0226d115-0796-44b2-a03f-250d65f4b156', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3d68e7-4166-4601-a60c-aeb07e53559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:53 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Volume volume-0226d115-0796-44b2-a03f-250d65f4b156 (0226d115-0796-44b2-a03f-250d65f4b156): created successfully Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a3d68e7-4166-4601-a60c-aeb07e53559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (d528e35f-78b5-46d1-b19c-6d40e6b883ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c2fe1081-2ef8-4d9e-a0c1-4e0223f8a4d0 tempest-VolumesActionsTest-1086408705 None] Created volume successfully. Nov 05 22:18:53 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Lock "cinder-quobyte-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb" released by "delete_volume" :: held 0.992s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Created reservations ['75dba458-64f0-49da-bdf4-839e693c1110', '91ed7b90-bc63-4242-a66f-1bd080c12d7f', '07c76fa4-9e9b-48b1-ad02-0c26a0fbddac', '8aeafcef-2e1c-4dc4-a244-61d6f207a2b3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:53 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:18:53 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:54 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.272s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Deleted volume successfully. Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4807ede4-5bf3-4e30-910e-ad082b081705 tempest-VolumesTransfersTest-1799050084 None] Lock "cinder-77a698be-af4f-4bd4-b7b9-ee2a257dc4cb-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Acquiring lock "cinder-0226d115-0796-44b2-a03f-250d65f4b156-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Lock "cinder-0226d115-0796-44b2-a03f-250d65f4b156-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Acquiring lock "cinder-quobyte-0226d115-0796-44b2-a03f-250d65f4b156" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Lock "cinder-quobyte-0226d115-0796-44b2-a03f-250d65f4b156" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50adcfc-b1f4-4ee9-a565-9aaa47f6126a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:54 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156 Nov 05 22:18:54 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:54 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156" returned: 0 in 0.385s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:54 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156 Nov 05 22:18:54 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-b4eb380c-308c-47fc-a212-0fce291d7bcf req-8ed85d8a-0e7e-4abb-a65d-d3db5cf48411 tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-b4eb380c-308c-47fc-a212-0fce291d7bcf req-8ed85d8a-0e7e-4abb-a65d-d3db5cf48411 tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-b4eb380c-308c-47fc-a212-0fce291d7bcf req-8ed85d8a-0e7e-4abb-a65d-d3db5cf48411 tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-b4eb380c-308c-47fc-a212-0fce291d7bcf req-8ed85d8a-0e7e-4abb-a65d-d3db5cf48411 tempest-ServerActionsTestOtherA-1281941995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dddc63e8-d916-4ed7-9f70-dba664d62df5', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:18:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-b4eb380c-308c-47fc-a212-0fce291d7bcf req-8ed85d8a-0e7e-4abb-a65d-d3db5cf48411 tempest-ServerActionsTestOtherA-1281941995 None] attachment_update completed successfully. Nov 05 22:18:55 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0226d115-0796-44b2-a03f-250d65f4b156" returned: 0 in 0.366s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Lock "cinder-quobyte-0226d115-0796-44b2-a03f-250d65f4b156" released by "delete_volume" :: held 0.818s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Created reservations ['8824ecf0-8c37-4a93-9e50-a996a76b9596', '9e9dc4fe-2d77-41ff-a1d2-5333be864a3b', 'f70fd0bb-7dca-4472-9d0a-976ede173ee1', '7e9d1e4b-e29d-40e0-93fd-da0d60028dce'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:55 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:18:55 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:55 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.391s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Deleted volume successfully. Nov 05 22:18:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8db58aee-464a-4b1f-ab7c-280247f72232 tempest-VolumesActionsTest-666815607 None] Lock "cinder-0226d115-0796-44b2-a03f-250d65f4b156-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (e593b69b-7f84-42dd-a7be-086b76855c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d351fa2-f47d-4b57-8b6f-b468d12d1adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d351fa2-f47d-4b57-8b6f-b468d12d1adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-72802024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61d10f7-b1fb-4610-af4e-ec66253834e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:56Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b83ec70-7640-4468-a337-1ff9536b4df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b83ec70-7640-4468-a337-1ff9536b4df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b095ba-1005-48e2-b9ef-636736ee0654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b095ba-1005-48e2-b9ef-636736ee0654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61d10f7-b1fb-4610-af4e-ec66253834e6', 'volume_name': 'volume-f61d10f7-b1fb-4610-af4e-ec66253834e6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479c5ea8-40d9-484c-a491-047835f066f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479c5ea8-40d9-484c-a491-047835f066f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6b7c1d-e2f6-480e-918e-209e0460fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Volume f61d10f7-b1fb-4610-af4e-ec66253834e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61d10f7-b1fb-4610-af4e-ec66253834e6', 'volume_size': 1} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-72802024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61d10f7-b1fb-4610-af4e-ec66253834e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777cffcc812a467f8c2a452d942fbebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:56Z,use_quota=True,user_id='d2ee8e08e1a440b0b6c22b3fb3266c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Creating volume f61d10f7-b1fb-4610-af4e-ec66253834e6 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:56 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:18:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:56 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6 1073741824 Nov 05 22:18:56 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:57 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6 1073741824" returned: 0 in 0.760s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:57 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6 Nov 05 22:18:57 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:57 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:57 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:18:57 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6b7c1d-e2f6-480e-918e-209e0460fad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61d10f7-b1fb-4610-af4e-ec66253834e6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acea1c08-1eb7-4831-a838-cb733ba9c671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:57 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Volume volume-f61d10f7-b1fb-4610-af4e-ec66253834e6 (f61d10f7-b1fb-4610-af4e-ec66253834e6): created successfully Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acea1c08-1eb7-4831-a838-cb733ba9c671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Flow 'volume_create_manager' (e593b69b-7f84-42dd-a7be-086b76855c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b5b9af48-701d-4ba9-82df-730229a807f4 tempest-VolumesActionsTest-1086408705 None] Created volume successfully. Nov 05 22:18:58 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.450s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:58 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:18:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:18:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:18:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "cinder-f61d10f7-b1fb-4610-af4e-ec66253834e6-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Lock "cinder-f61d10f7-b1fb-4610-af4e-ec66253834e6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "cinder-quobyte-f61d10f7-b1fb-4610-af4e-ec66253834e6" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Lock "cinder-quobyte-f61d10f7-b1fb-4610-af4e-ec66253834e6" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[33148c77-e745-490d-a441-53a07d84b9d9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:00 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6 Nov 05 22:19:00 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:00 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6" returned: 0 in 0.525s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:00 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6 Nov 05 22:19:00 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:00 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f61d10f7-b1fb-4610-af4e-ec66253834e6" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Lock "cinder-quobyte-f61d10f7-b1fb-4610-af4e-ec66253834e6" released by "delete_volume" :: held 1.074s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Created reservations ['dae68396-0579-4b12-baa4-8ec9a8e1efa2', 'ae09bd25-e49d-4333-97ed-af6cdb6d090e', '12467090-5be9-4d3b-ac91-b5b7c70046f2', '88418b2c-8094-4c86-9e04-7c6b6c9b5269'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:01 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:01 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:01 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.477s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:01 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Deleted volume successfully. Nov 05 22:19:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-49e3d7d9-919d-419d-b7f2-0e646a00d916 tempest-VolumesActionsTest-1086408705 None] Lock "cinder-f61d10f7-b1fb-4610-af4e-ec66253834e6-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:11 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=29,cinder:INSERT=9,cinder:UPDATE=43,cinder:DELETE=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:19:11 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:INSERT=10,cinder:SELECT=34,cinder:UPDATE=41,cinder:DELETE=5 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:19:17 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Flow 'volume_create_manager' (2ccd6e24-267c-4e8d-ad22-5aba205d6ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb7916d-5cca-4b8f-9ebb-728e88931e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb7916d-5cca-4b8f-9ebb-728e88931e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1200182306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25d8028-262f-4f80-ad95-9a1c62a88c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d2f323bd274df7b9736b19dcbe1e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:18Z,use_quota=True,user_id='5f7c777082ff45e6b25561002dcd706b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca2004b-98b3-4742-8fca-2cbbb34f5cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca2004b-98b3-4742-8fca-2cbbb34f5cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16913497-4f3b-4675-8432-a5edc7f92fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16913497-4f3b-4675-8432-a5edc7f92fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25d8028-262f-4f80-ad95-9a1c62a88c97', 'volume_name': 'volume-c25d8028-262f-4f80-ad95-9a1c62a88c97', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c24bf5d-5992-4772-8305-5421de44b9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c24bf5d-5992-4772-8305-5421de44b9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d3e1f4-142d-451e-8a99-a939c67c7f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Volume c25d8028-262f-4f80-ad95-9a1c62a88c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25d8028-262f-4f80-ad95-9a1c62a88c97', 'volume_size': 1} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1200182306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25d8028-262f-4f80-ad95-9a1c62a88c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d2f323bd274df7b9736b19dcbe1e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:18Z,use_quota=True,user_id='5f7c777082ff45e6b25561002dcd706b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Creating volume c25d8028-262f-4f80-ad95-9a1c62a88c97 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:18 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:18 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 1073741824 Nov 05 22:19:18 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:18 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 1073741824" returned: 0 in 0.617s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:18 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 Nov 05 22:19:18 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:18 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d3e1f4-142d-451e-8a99-a939c67c7f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25d8028-262f-4f80-ad95-9a1c62a88c97', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6582c498-cc28-4c60-8459-e5c778f0e52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Volume volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 (c25d8028-262f-4f80-ad95-9a1c62a88c97): created successfully Nov 05 22:19:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6582c498-cc28-4c60-8459-e5c778f0e52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Flow 'volume_create_manager' (2ccd6e24-267c-4e8d-ad22-5aba205d6ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-60b43f9e-c486-4e4f-aee7-057c5148993d tempest-VolumesActionsTest-514083010 None] Created volume successfully. Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Flow 'volume_create_manager' (936b5836-8e28-4985-bb10-958d22907efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab60c1b9-af8e-4108-a509-b9ce93919db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab60c1b9-af8e-4108-a509-b9ce93919db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-961535800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e7b39e-b727-42ec-8a84-714700d2b0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dced9c5ec9c1446c99bb6299b97b2f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:22Z,use_quota=True,user_id='42c214a1538e4d86b573eef3f995c344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc05715-659e-41d7-a8b2-afdacd8f582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc05715-659e-41d7-a8b2-afdacd8f582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372713e6-b4de-4ae9-8974-c37382c2c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372713e6-b4de-4ae9-8974-c37382c2c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e7b39e-b727-42ec-8a84-714700d2b0b8', 'volume_name': 'volume-52e7b39e-b727-42ec-8a84-714700d2b0b8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef95cfc4-0b5e-4e62-8e1d-5e5e46a0bc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef95cfc4-0b5e-4e62-8e1d-5e5e46a0bc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b8c596-6435-4158-a0c4-a4155ebaa6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Volume 52e7b39e-b727-42ec-8a84-714700d2b0b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e7b39e-b727-42ec-8a84-714700d2b0b8', 'volume_size': 1} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-961535800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e7b39e-b727-42ec-8a84-714700d2b0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dced9c5ec9c1446c99bb6299b97b2f73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:22Z,use_quota=True,user_id='42c214a1538e4d86b573eef3f995c344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Creating volume 52e7b39e-b727-42ec-8a84-714700d2b0b8 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:22 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:22 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8 1073741824 Nov 05 22:19:22 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:22 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8 1073741824" returned: 0 in 0.740s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:22 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8 Nov 05 22:19:22 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:23 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8" returned: 0 in 0.453s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b8c596-6435-4158-a0c4-a4155ebaa6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e7b39e-b727-42ec-8a84-714700d2b0b8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4084980c-7636-4acf-a733-b23f01c8acc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Volume volume-52e7b39e-b727-42ec-8a84-714700d2b0b8 (52e7b39e-b727-42ec-8a84-714700d2b0b8): created successfully Nov 05 22:19:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4084980c-7636-4acf-a733-b23f01c8acc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Flow 'volume_create_manager' (936b5836-8e28-4985-bb10-958d22907efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e22989a7-24e9-4773-b915-ecb0ba3d4fa1 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Created volume successfully. Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Acquiring lock "cinder-52e7b39e-b727-42ec-8a84-714700d2b0b8-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Lock "cinder-52e7b39e-b727-42ec-8a84-714700d2b0b8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Acquiring lock "cinder-quobyte-52e7b39e-b727-42ec-8a84-714700d2b0b8" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Lock "cinder-quobyte-52e7b39e-b727-42ec-8a84-714700d2b0b8" acquired by "delete_volume" :: waited 0.047s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eec5f5a-e730-4db9-96a9-5296a2d8e5f3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Flow 'volume_create_manager' (732dd170-bcbd-4073-b279-aa3e2c54c648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cb3b1f-1ea0-4305-a7b0-516e82a4b0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:26 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8 Nov 05 22:19:26 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cb3b1f-1ea0-4305-a7b0-516e82a4b0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1589076860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a585017a-0117-472a-aee0-01b1c5e92bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e0d8d4755d43c3ad9864097bc2057e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:27Z,use_quota=True,user_id='c4cc264f06c34f069a75c720633c907e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d2c96d-b736-4ec6-9d2a-a797912afd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d2c96d-b736-4ec6-9d2a-a797912afd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f53084-b4c4-411e-8826-93728f25a743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f53084-b4c4-411e-8826-93728f25a743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a585017a-0117-472a-aee0-01b1c5e92bae', 'volume_name': 'volume-a585017a-0117-472a-aee0-01b1c5e92bae', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863ca302-32e4-402f-b634-fe8894e8d64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (863ca302-32e4-402f-b634-fe8894e8d64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfdecba-c6b4-4c69-b07a-c2903261d3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Volume a585017a-0117-472a-aee0-01b1c5e92bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a585017a-0117-472a-aee0-01b1c5e92bae', 'volume_size': 1} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1589076860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a585017a-0117-472a-aee0-01b1c5e92bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e0d8d4755d43c3ad9864097bc2057e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:27Z,use_quota=True,user_id='c4cc264f06c34f069a75c720633c907e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Creating volume a585017a-0117-472a-aee0-01b1c5e92bae {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:26 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:19:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:26 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae 1073741824 Nov 05 22:19:26 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:27 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8" returned: 0 in 0.729s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:27 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8 Nov 05 22:19:27 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:27 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae 1073741824" returned: 0 in 0.703s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:27 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-52e7b39e-b727-42ec-8a84-714700d2b0b8" returned: 0 in 0.350s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Lock "cinder-quobyte-52e7b39e-b727-42ec-8a84-714700d2b0b8" released by "delete_volume" :: held 1.174s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:27 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae Nov 05 22:19:27 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Created reservations ['db4e9a87-9936-43a1-a758-70da88440eae', '938a3177-2512-4f9c-bf61-05c13679fc4f', '34fad355-4036-4509-88cd-adfdb2fd42dc', '58970275-fab5-431d-91c4-07ec59e453d1'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:27 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:27 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:27 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae" returned: 0 in 0.350s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfdecba-c6b4-4c69-b07a-c2903261d3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a585017a-0117-472a-aee0-01b1c5e92bae', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b027590c-04c8-4c15-9090-9a6000b16e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Volume volume-a585017a-0117-472a-aee0-01b1c5e92bae (a585017a-0117-472a-aee0-01b1c5e92bae): created successfully Nov 05 22:19:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b027590c-04c8-4c15-9090-9a6000b16e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Flow 'volume_create_manager' (732dd170-bcbd-4073-b279-aa3e2c54c648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1165868c-e296-4b33-982f-2833136acac3 tempest-VolumesListAdminTestJSON-1676270512 None] Created volume successfully. Nov 05 22:19:28 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.405s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:28 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Deleted volume successfully. Nov 05 22:19:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a0ff6b5-d405-440f-aab3-cfc9f3003336 tempest-VolumeQuotasNegativeTestJSON-1450637392 None] Lock "cinder-52e7b39e-b727-42ec-8a84-714700d2b0b8-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Flow 'volume_create_manager' (4afb7c86-6124-44c2-951c-5106e4f2a236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cebb22d-80b0-4e9e-a422-217ebc6f4af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cebb22d-80b0-4e9e-a422-217ebc6f4af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-731191269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036471ab-12ca-495f-bc86-6405de0079ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e0d8d4755d43c3ad9864097bc2057e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:29Z,use_quota=True,user_id='c4cc264f06c34f069a75c720633c907e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f128a437-f12f-4751-894a-3b65bb283283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f128a437-f12f-4751-894a-3b65bb283283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b075dd4-0748-43e4-b63e-695799e7bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b075dd4-0748-43e4-b63e-695799e7bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036471ab-12ca-495f-bc86-6405de0079ae', 'volume_name': 'volume-036471ab-12ca-495f-bc86-6405de0079ae', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8dd5bd-c6fc-4031-bcfa-6db49b0d8663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8dd5bd-c6fc-4031-bcfa-6db49b0d8663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c1c2c1-d250-4c75-ae09-e76c1a4cc048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:29 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Volume 036471ab-12ca-495f-bc86-6405de0079ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036471ab-12ca-495f-bc86-6405de0079ae', 'volume_size': 1} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-731191269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036471ab-12ca-495f-bc86-6405de0079ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e0d8d4755d43c3ad9864097bc2057e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:29Z,use_quota=True,user_id='c4cc264f06c34f069a75c720633c907e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Creating volume 036471ab-12ca-495f-bc86-6405de0079ae {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:29 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:29 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae 1073741824 Nov 05 22:19:29 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f864b260-d1fc-456c-b210-3b83f1c35814 tempest-VolumesActionsTest-514083010 None] Acquiring lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97" by "attach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f864b260-d1fc-456c-b210-3b83f1c35814 tempest-VolumesActionsTest-514083010 None] Lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97" acquired by "attach_volume" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f864b260-d1fc-456c-b210-3b83f1c35814 tempest-VolumesActionsTest-514083010 None] Attaching volume c25d8028-262f-4f80-ad95-9a1c62a88c97 to instance d8a50782-b658-492c-89c6-68d4c4620364 at mountpoint /dev/vdb on host None. Nov 05 22:19:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f864b260-d1fc-456c-b210-3b83f1c35814 tempest-VolumesActionsTest-514083010 None] Attach volume completed successfully. Nov 05 22:19:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f864b260-d1fc-456c-b210-3b83f1c35814 tempest-VolumesActionsTest-514083010 None] Lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97" released by "attach_volume" :: held 0.152s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:30 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae 1073741824" returned: 0 in 0.793s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b615027-87a6-4f6d-8193-71fee7a49f21 tempest-VolumesActionsTest-514083010 None] Acquiring lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97-detach_volume" by "detach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:30 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae Nov 05 22:19:30 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b615027-87a6-4f6d-8193-71fee7a49f21 tempest-VolumesActionsTest-514083010 None] Lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1b615027-87a6-4f6d-8193-71fee7a49f21 tempest-VolumesActionsTest-514083010 None] Detaching volume c25d8028-262f-4f80-ad95-9a1c62a88c97 from instance d8a50782-b658-492c-89c6-68d4c4620364. Nov 05 22:19:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1b615027-87a6-4f6d-8193-71fee7a49f21 tempest-VolumesActionsTest-514083010 None] Detach volume completed successfully. Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b615027-87a6-4f6d-8193-71fee7a49f21 tempest-VolumesActionsTest-514083010 None] Lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:30 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae" returned: 0 in 0.403s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c1c2c1-d250-4c75-ae09-e76c1a4cc048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036471ab-12ca-495f-bc86-6405de0079ae', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794d0ab6-ad2f-4865-869b-ee5912ece678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Volume volume-036471ab-12ca-495f-bc86-6405de0079ae (036471ab-12ca-495f-bc86-6405de0079ae): created successfully Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794d0ab6-ad2f-4865-869b-ee5912ece678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Flow 'volume_create_manager' (4afb7c86-6124-44c2-951c-5106e4f2a236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ce69df9a-18a9-4799-8a74-24a7d3c83953 tempest-VolumesListAdminTestJSON-1676270512 None] Created volume successfully. Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Flow 'volume_create_manager' (8d5ae035-add9-409f-8544-462e6ad7a17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956334e9-fc02-4d44-9e99-1b374a573b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956334e9-fc02-4d44-9e99-1b374a573b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-560126253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e26e67-e9e4-4a78-9455-7a59f64e49b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e0d8d4755d43c3ad9864097bc2057e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:32Z,use_quota=True,user_id='c4cc264f06c34f069a75c720633c907e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf7101d-4163-4df9-8f53-6cef13ecc643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf7101d-4163-4df9-8f53-6cef13ecc643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298d459a-b6b5-4f2f-ae1f-0b69130d09be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298d459a-b6b5-4f2f-ae1f-0b69130d09be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e26e67-e9e4-4a78-9455-7a59f64e49b7', 'volume_name': 'volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514731f0-c96d-4eed-bce7-c4e8133889d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514731f0-c96d-4eed-bce7-c4e8133889d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6727bca0-ab59-4ca0-b23a-58d0dc1593c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:32 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Volume 99e26e67-e9e4-4a78-9455-7a59f64e49b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7', 'volume_size': 1} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-560126253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e26e67-e9e4-4a78-9455-7a59f64e49b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e0d8d4755d43c3ad9864097bc2057e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:32Z,use_quota=True,user_id='c4cc264f06c34f069a75c720633c907e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Creating volume 99e26e67-e9e4-4a78-9455-7a59f64e49b7 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:32 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:19:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:32 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7 1073741824 Nov 05 22:19:32 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:33 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7 1073741824" returned: 0 in 0.611s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:33 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7 Nov 05 22:19:33 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-4056187b-8901-4389-bb15-df04bb7b0dc1 tempest-ServerActionsTestOtherA-1281941995 None] Terminate volume connection completed successfully. Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-4056187b-8901-4389-bb15-df04bb7b0dc1 tempest-ServerActionsTestOtherA-1281941995 None] Deleting attachment dddc63e8-d916-4ed7-9f70-dba664d62df5. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:19:33 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7" returned: 0 in 0.378s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6727bca0-ab59-4ca0-b23a-58d0dc1593c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ed8090-f363-4976-ac07-74786fbb8f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "cinder-b95b7521-cf66-4c5c-bc23-b3413e1df64b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Volume volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7 (99e26e67-e9e4-4a78-9455-7a59f64e49b7): created successfully Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ed8090-f363-4976-ac07-74786fbb8f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Flow 'volume_create_manager' (8d5ae035-add9-409f-8544-462e6ad7a17e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Lock "cinder-b95b7521-cf66-4c5c-bc23-b3413e1df64b-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-df3ae32a-88a9-456d-846c-f3b2bf69ea74 tempest-VolumesListAdminTestJSON-1676270512 None] Created volume successfully. Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "cinder-quobyte-b95b7521-cf66-4c5c-bc23-b3413e1df64b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Lock "cinder-quobyte-b95b7521-cf66-4c5c-bc23-b3413e1df64b" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb41fc-ff2b-498e-8d89-4a106a7186c7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:34 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b Nov 05 22:19:34 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:34 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b" returned: 0 in 0.494s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:34 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b Nov 05 22:19:34 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:34 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b95b7521-cf66-4c5c-bc23-b3413e1df64b" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Lock "cinder-quobyte-b95b7521-cf66-4c5c-bc23-b3413e1df64b" released by "delete_volume" :: held 0.896s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "cinder-6d107632-2615-41cb-91f7-ea8061aa2a74-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Lock "cinder-6d107632-2615-41cb-91f7-ea8061aa2a74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG cinder.quota [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Created reservations ['ed43fc1f-97b5-415b-9d93-b6fe31565619', '0f2263d8-af2e-4c38-b743-400b53379910', 'cfe84f1d-e5eb-4d64-99d6-1c9f58bc314d', 'c1539112-de87-4a9d-9b4c-e09a0654e31e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "cinder-quobyte-6d107632-2615-41cb-91f7-ea8061aa2a74" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Lock "cinder-quobyte-6d107632-2615-41cb-91f7-ea8061aa2a74" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1fdbc0-5e70-4639-8e31-461cedc1e963]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:35 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:35 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:35 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74 Nov 05 22:19:35 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:35 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.319s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.manager [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Deleted volume successfully. Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-263a6b85-473d-491b-bef3-1bc0c17a9d9c req-b93c8769-f6d6-4b8b-94b2-addb779fce89 tempest-ServerActionsTestOtherA-1281941995 None] Lock "cinder-b95b7521-cf66-4c5c-bc23-b3413e1df64b-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:35 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74" returned: 0 in 0.670s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:35 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74 Nov 05 22:19:35 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Flow 'volume_create_manager' (38264555-8e3e-4214-9c84-e2837c7ee15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6703e0ff-955a-42cd-9bde-6fcf5e1a65de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6703e0ff-955a-42cd-9bde-6fcf5e1a65de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09796e6-11c5-4b94-80da-0144d573e030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13ebe3a37b24be09042a2c955a625c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:36Z,use_quota=True,user_id='21ae24238d484e7182c86aa7e9b501e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad446f36-da24-42b4-8a50-f7dd68392079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad446f36-da24-42b4-8a50-f7dd68392079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166cd995-47bf-4a2e-99b7-a8a33a59c346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166cd995-47bf-4a2e-99b7-a8a33a59c346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09796e6-11c5-4b94-80da-0144d573e030', 'volume_name': 'volume-b09796e6-11c5-4b94-80da-0144d573e030', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dddb1f-3053-479b-83b8-da4b1aeb39a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dddb1f-3053-479b-83b8-da4b1aeb39a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd7489b-0cec-468a-b1cd-dff0e09e6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Volume b09796e6-11c5-4b94-80da-0144d573e030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09796e6-11c5-4b94-80da-0144d573e030', 'volume_size': 1} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09796e6-11c5-4b94-80da-0144d573e030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13ebe3a37b24be09042a2c955a625c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:36Z,use_quota=True,user_id='21ae24238d484e7182c86aa7e9b501e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Creating volume b09796e6-11c5-4b94-80da-0144d573e030 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:35 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:35 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030 1073741824 Nov 05 22:19:35 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:35 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6d107632-2615-41cb-91f7-ea8061aa2a74" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Lock "cinder-quobyte-6d107632-2615-41cb-91f7-ea8061aa2a74" released by "delete_volume" :: held 1.068s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Created reservations ['6f0ae914-be41-457e-9e00-2a949e73afe7', '6acbb302-c4cb-4cff-b151-40910b5f7a95', '872d326e-4727-4879-9601-3b21cffb0a9e', '861a7b33-1339-4aa7-b940-f95ff29aaaff'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:36 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:36 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:36 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030 1073741824" returned: 0 in 0.581s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:36 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Deleted volume successfully. Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:36 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030 Nov 05 22:19:36 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b50f5871-8f7f-4361-938d-bee3824cc881 tempest-ServerActionsTestOtherA-1281941995 None] Lock "cinder-6d107632-2615-41cb-91f7-ea8061aa2a74-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:36 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030" returned: 0 in 0.313s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd7489b-0cec-468a-b1cd-dff0e09e6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09796e6-11c5-4b94-80da-0144d573e030', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffaf7c8-b1f6-4b6a-ab06-4bee0e445396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:36 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Volume volume-b09796e6-11c5-4b94-80da-0144d573e030 (b09796e6-11c5-4b94-80da-0144d573e030): created successfully Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffaf7c8-b1f6-4b6a-ab06-4bee0e445396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Flow 'volume_create_manager' (38264555-8e3e-4214-9c84-e2837c7ee15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-40f74500-f6cd-4868-8cbb-2441069f8346 tempest-VolumesListAdminTestJSON-362566883 None] Created volume successfully. Nov 05 22:19:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Acquiring lock "cinder-b09796e6-11c5-4b94-80da-0144d573e030-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Lock "cinder-b09796e6-11c5-4b94-80da-0144d573e030-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Acquiring lock "cinder-quobyte-b09796e6-11c5-4b94-80da-0144d573e030" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Lock "cinder-quobyte-b09796e6-11c5-4b94-80da-0144d573e030" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f9be8a-6778-49df-94df-aeebc21ba3f0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "cinder-99e26e67-e9e4-4a78-9455-7a59f64e49b7-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-99e26e67-e9e4-4a78-9455-7a59f64e49b7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:38 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030 Nov 05 22:19:38 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "cinder-quobyte-99e26e67-e9e4-4a78-9455-7a59f64e49b7" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-quobyte-99e26e67-e9e4-4a78-9455-7a59f64e49b7" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[747cf3d1-6e6d-4149-97d8-97dbb5331312]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:38 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7 Nov 05 22:19:38 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:38 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030" returned: 0 in 0.676s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:38 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030 Nov 05 22:19:38 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:39 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b09796e6-11c5-4b94-80da-0144d573e030" returned: 0 in 0.538s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Lock "cinder-quobyte-b09796e6-11c5-4b94-80da-0144d573e030" released by "delete_volume" :: held 1.325s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:39 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7" returned: 0 in 1.005s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Created reservations ['f6d8df6a-e5a2-47a2-b6e3-a0ae5ffe906a', '9d9e3564-fe2e-4b6b-9caf-7b38984581ff', 'cba9ce9d-1250-498a-80b7-a7310ab83769', '149a02c5-1954-494e-84cd-1176821ae427'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:39 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7 Nov 05 22:19:39 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:39 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:39 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:39 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-99e26e67-e9e4-4a78-9455-7a59f64e49b7" returned: 0 in 0.424s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-quobyte-99e26e67-e9e4-4a78-9455-7a59f64e49b7" released by "delete_volume" :: held 1.516s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Flow 'volume_create_manager' (0738e72b-801d-4f83-ae8f-c50c973df8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801825df-9e71-4a4e-a5aa-adbb8993b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801825df-9e71-4a4e-a5aa-adbb8993b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-493871477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4d81aa-24a4-42ee-ac04-7d814b9b7277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b4f5c44e7a4cd084dcd49018d86e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:40Z,use_quota=True,user_id='0ecd29922d314aac8bdfdbadfb751eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1664e749-18df-44c2-a473-e2b70b3a25b5),volume_type_id=1664e749-18df-44c2-a473-e2b70b3a25b5)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9161b838-9162-4664-a30f-e5db349c421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:40 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9161b838-9162-4664-a30f-e5db349c421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32acd873-fb84-4421-990a-0948af6c6863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32acd873-fb84-4421-990a-0948af6c6863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4d81aa-24a4-42ee-ac04-7d814b9b7277', 'volume_name': 'volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5990a5ff-25ca-4c79-9037-0105e27426de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5990a5ff-25ca-4c79-9037-0105e27426de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c129cdc-06d3-4094-8b29-5012cb8a2b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Volume 0c4d81aa-24a4-42ee-ac04-7d814b9b7277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277', 'volume_size': 1} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-493871477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4d81aa-24a4-42ee-ac04-7d814b9b7277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b4f5c44e7a4cd084dcd49018d86e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:40Z,use_quota=True,user_id='0ecd29922d314aac8bdfdbadfb751eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1664e749-18df-44c2-a473-e2b70b3a25b5),volume_type_id=1664e749-18df-44c2-a473-e2b70b3a25b5)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Creating volume 0c4d81aa-24a4-42ee-ac04-7d814b9b7277 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:40 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.579s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Deleted volume successfully. Nov 05 22:19:40 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277 1073741824 Nov 05 22:19:40 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e74c8f51-c5a7-4a61-b7c3-817b6f27503c tempest-VolumesListAdminTestJSON-362566883 None] Lock "cinder-b09796e6-11c5-4b94-80da-0144d573e030-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Created reservations ['43d6bbac-ab3d-4db3-8c40-35c88b8992e2', '8b7e8ae9-5ae6-4a7f-bbfd-d165b5fc3d4c', '74622a78-2209-46ea-a36a-13e609b3109e', '413916cf-9c63-4923-803f-a5902c3647fa'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:40 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:40 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "cinder-036471ab-12ca-495f-bc86-6405de0079ae-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-036471ab-12ca-495f-bc86-6405de0079ae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:40 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.346s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Deleted volume successfully. Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "cinder-quobyte-036471ab-12ca-495f-bc86-6405de0079ae" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8bb18bfa-c40a-447c-84bc-b4919b4cf147 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-99e26e67-e9e4-4a78-9455-7a59f64e49b7-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-quobyte-036471ab-12ca-495f-bc86-6405de0079ae" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[11711940-b2a0-4cfa-8064-235cbd935c0a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:40 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277 1073741824" returned: 0 in 0.756s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:41 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277 Nov 05 22:19:41 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:41 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae Nov 05 22:19:41 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:41 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277" returned: 0 in 0.303s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c129cdc-06d3-4094-8b29-5012cb8a2b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9241c1-dec8-43f8-962b-ae24b913dfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Volume volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277 (0c4d81aa-24a4-42ee-ac04-7d814b9b7277): created successfully Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9241c1-dec8-43f8-962b-ae24b913dfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Flow 'volume_create_manager' (0738e72b-801d-4f83-ae8f-c50c973df8ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:41 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae" returned: 0 in 0.486s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8a79466d-d58f-48a0-ab4b-f4f068d88fce tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Created volume successfully. Nov 05 22:19:41 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae Nov 05 22:19:41 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:41 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-036471ab-12ca-495f-bc86-6405de0079ae" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-quobyte-036471ab-12ca-495f-bc86-6405de0079ae" released by "delete_volume" :: held 0.827s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Created reservations ['24c1f60b-4b7e-40ae-abbf-435698c0bbb4', 'ec05b595-a288-49bf-9cc1-bbd628ebe8b8', 'c5fe6dd7-425f-46ce-bc24-904a39cb83e9', '6c3ff9b2-b5a3-4a38-b1ea-150e6e63d476'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:41 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:41 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "cinder-a585017a-0117-472a-aee0-01b1c5e92bae-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-a585017a-0117-472a-aee0-01b1c5e92bae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "cinder-quobyte-a585017a-0117-472a-aee0-01b1c5e92bae" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-quobyte-a585017a-0117-472a-aee0-01b1c5e92bae" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:42 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.420s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Deleted volume successfully. Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a5e387-bd7d-485d-928b-18a6c7d71414]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0d7c4da2-64fa-4558-b6bb-cff2f6ec4e2a tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-036471ab-12ca-495f-bc86-6405de0079ae-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:42 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae Nov 05 22:19:42 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6f4630fb-5ef3-4ce9-9880-7e82bfbee093 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6f4630fb-5ef3-4ce9-9880-7e82bfbee093 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6f4630fb-5ef3-4ce9-9880-7e82bfbee093 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6f4630fb-5ef3-4ce9-9880-7e82bfbee093 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6f4630fb-5ef3-4ce9-9880-7e82bfbee093 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6f4630fb-5ef3-4ce9-9880-7e82bfbee093 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:43 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:43 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:43 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae" returned: 0 in 0.706s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:43 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae Nov 05 22:19:43 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:43 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6f4630fb-5ef3-4ce9-9880-7e82bfbee093 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.518s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:43 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-6f4630fb-5ef3-4ce9-9880-7e82bfbee093 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6f4630fb-5ef3-4ce9-9880-7e82bfbee093 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Retype volume completed successfully. Nov 05 22:19:43 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a585017a-0117-472a-aee0-01b1c5e92bae" returned: 0 in 0.658s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-quobyte-a585017a-0117-472a-aee0-01b1c5e92bae" released by "delete_volume" :: held 1.438s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Created reservations ['b17b79a7-1218-4a10-a5df-f3461d99f638', 'f30e8342-c30f-40a5-a8f0-aba5fb0d2d59', '27292acf-c700-4df1-a72f-d9aa1fdd9558', 'a08f0e2a-e288-4ef1-9d5a-f61d05ccd15c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:44 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:44 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:44 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.537s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Deleted volume successfully. Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f9960bb4-59a2-4ba8-97ca-3a8a6c506223 tempest-VolumesListAdminTestJSON-1676270512 None] Lock "cinder-a585017a-0117-472a-aee0-01b1c5e92bae-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Acquiring lock "cinder-0c4d81aa-24a4-42ee-ac04-7d814b9b7277-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "cinder-0c4d81aa-24a4-42ee-ac04-7d814b9b7277-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Acquiring lock "cinder-quobyte-0c4d81aa-24a4-42ee-ac04-7d814b9b7277" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "cinder-quobyte-0c4d81aa-24a4-42ee-ac04-7d814b9b7277" acquired by "delete_volume" :: waited 0.047s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69646d4-b7a7-4bdf-b127-93685db854bf]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:45 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277 Nov 05 22:19:45 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:45 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277" returned: 0 in 0.748s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:45 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277 Nov 05 22:19:45 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-08eca66d-7c41-4eef-bf18-213b82866ffa tempest-VolumesActionsTest-514083010 None] Acquiring lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97" by "attach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-08eca66d-7c41-4eef-bf18-213b82866ffa tempest-VolumesActionsTest-514083010 None] Lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97" acquired by "attach_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-08eca66d-7c41-4eef-bf18-213b82866ffa tempest-VolumesActionsTest-514083010 None] Attaching volume c25d8028-262f-4f80-ad95-9a1c62a88c97 to instance 3cdcc306-88c1-46c9-a7fa-4d7b9dfceb46 at mountpoint /dev/vdb on host None. Nov 05 22:19:46 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0c4d81aa-24a4-42ee-ac04-7d814b9b7277" returned: 0 in 0.616s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-08eca66d-7c41-4eef-bf18-213b82866ffa tempest-VolumesActionsTest-514083010 None] Attach volume completed successfully. Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "cinder-quobyte-0c4d81aa-24a4-42ee-ac04-7d814b9b7277" released by "delete_volume" :: held 1.475s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-08eca66d-7c41-4eef-bf18-213b82866ffa tempest-VolumesActionsTest-514083010 None] Lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97" released by "attach_volume" :: held 0.211s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:46 devstack cinder-volume[87122]: WARNING cinder.quota [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:19:46 devstack cinder-volume[87122]: WARNING cinder.quota [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Created reservations ['ae26b48d-1162-4d26-a0b0-efd14e61840d', '336e2e2f-7abd-4f41-8106-28a2512d15a6', '13d0f1af-a415-486b-9339-5d3e463b41b2', '03fd912a-2309-463c-8d2c-625f83a8f26e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:46 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:46 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:47 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.494s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:47 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b1ded2e4-bc0a-4742-a278-3023329bd917 tempest-VolumesActionsTest-514083010 None] Acquiring lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97-detach_volume" by "detach_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Deleted volume successfully. Nov 05 22:19:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b1ded2e4-bc0a-4742-a278-3023329bd917 tempest-VolumesActionsTest-514083010 None] Lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b1ded2e4-bc0a-4742-a278-3023329bd917 tempest-VolumesActionsTest-514083010 None] Detaching volume c25d8028-262f-4f80-ad95-9a1c62a88c97 from instance 3cdcc306-88c1-46c9-a7fa-4d7b9dfceb46. Nov 05 22:19:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9067e9de-e24c-4807-8b7c-aff45fed2b24 tempest-VolumeRetypeWithoutMigrationTest-671074503 None] Lock "cinder-0c4d81aa-24a4-42ee-ac04-7d814b9b7277-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b1ded2e4-bc0a-4742-a278-3023329bd917 tempest-VolumesActionsTest-514083010 None] Detach volume completed successfully. Nov 05 22:19:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b1ded2e4-bc0a-4742-a278-3023329bd917 tempest-VolumesActionsTest-514083010 None] Lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Flow 'volume_create_manager' (19028f0c-1274-4ecd-b9bc-b7bd46d9b71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a56409-3b4d-4b6f-b75d-219463358e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a56409-3b4d-4b6f-b75d-219463358e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2053979324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d01c80-0524-40a4-aff2-c2ed82faa5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36c622de293438da1fd35b38dfd6dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:53Z,use_quota=True,user_id='5a48401aec6d46d09513ad42caeba809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc13b930-7c35-4604-b089-960cd0523316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc13b930-7c35-4604-b089-960cd0523316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df9e5bf-68a4-416a-a9a0-60ca82502547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df9e5bf-68a4-416a-a9a0-60ca82502547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d01c80-0524-40a4-aff2-c2ed82faa5d4', 'volume_name': 'volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdde3559-b533-459b-a37b-9668894d1786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdde3559-b533-459b-a37b-9668894d1786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb1bf5f-f27f-4f0e-852b-576aa48136f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:52 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Volume 37d01c80-0524-40a4-aff2-c2ed82faa5d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4', 'volume_size': 1} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2053979324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d01c80-0524-40a4-aff2-c2ed82faa5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36c622de293438da1fd35b38dfd6dc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:53Z,use_quota=True,user_id='5a48401aec6d46d09513ad42caeba809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Creating volume 37d01c80-0524-40a4-aff2-c2ed82faa5d4 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:52 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:19:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:52 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 1073741824 Nov 05 22:19:52 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:53 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 1073741824" returned: 0 in 0.524s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:53 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 Nov 05 22:19:53 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:53 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.322s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb1bf5f-f27f-4f0e-852b-576aa48136f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faaf29a5-ad1e-4ed2-a256-c8a396171b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[72506b1d-7ccf-4c89-bcaf-7d591f3491c1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:53 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Volume volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 (37d01c80-0524-40a4-aff2-c2ed82faa5d4): created successfully Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faaf29a5-ad1e-4ed2-a256-c8a396171b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Flow 'volume_create_manager' (19028f0c-1274-4ecd-b9bc-b7bd46d9b71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-796657e7-78a0-423a-83b2-95c720718669 tempest-SnapshotMetadataTestJSON-1726983323 None] Created volume successfully. Nov 05 22:19:53 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 Nov 05 22:19:53 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:54 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4069eacc-6555-40ce-a880-9a3907ca7fcb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:54 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 Nov 05 22:19:54 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:54 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97" returned: 0 in 0.436s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.35d4e9c3-6536-411b-955e-1832b09053988d_6ej58.img {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:54 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.35d4e9c3-6536-411b-955e-1832b09053988d_6ej58.img Nov 05 22:19:54 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:57 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:19:57 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Flow 'volume_create_manager' (e91a050b-4026-4f51-8745-c9ef2de78f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf25738-7ccb-49bf-94bb-ed561700227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf25738-7ccb-49bf-94bb-ed561700227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1185022193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ccad61-f8f8-4a01-8f05-ec4326db1a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5901006699b34e60930949925fd0c9df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:58Z,use_quota=True,user_id='3f4a66ef97ac4758afae09c84faccf85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2dcdd9c-8ac7-420e-abca-f9639198361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2dcdd9c-8ac7-420e-abca-f9639198361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70050415-7f5f-425b-9bc1-be6693c15199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70050415-7f5f-425b-9bc1-be6693c15199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ccad61-f8f8-4a01-8f05-ec4326db1a66', 'volume_name': 'volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedf2774-5977-42ee-9167-5fe416b54b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedf2774-5977-42ee-9167-5fe416b54b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea76f570-3613-451e-b006-eaea07db34a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:57 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Volume 22ccad61-f8f8-4a01-8f05-ec4326db1a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66', 'volume_size': 1} Nov 05 22:19:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:58 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.664s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:58 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:19:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:19:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:20:01 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.35d4e9c3-6536-411b-955e-1832b09053988d_6ej58.img" returned: 0 in 7.490s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:01 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f3d580-ca1f-4f7a-a5f8-43903da04503]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:02 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 Nov 05 22:20:02 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:02 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97" returned: 0 in 0.555s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:02 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.35d4e9c3-6536-411b-955e-1832b09053988d_6ej58.img {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:20:02 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Converted 1024.00 MB image at 136.71 MB/s Nov 05 22:20:02 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] 35d4e9c3-6536-411b-955e-1832b0905398 was raw, no need to convert to raw {{(pid=87122) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 22:20:12 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=91,cinder:INSERT=26,cinder:SELECT=72,cinder:DELETE=10 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:20:12 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=88,cinder:UPDATE=108,cinder:DELETE=6,cinder:INSERT=18 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:20:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.392s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Uploaded volume to glance image-id: 35d4e9c3-6536-411b-955e-1832b0905398. {{(pid=87122) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 22:20:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 29.849s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Creating offline snapshot 2a14aece-66ef-484b-9bd2-9edf079d0ee4 of volume 37d01c80-0524-40a4-aff2-c2ed82faa5d4 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:20:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d8ff6e27-2467-4c2a-8430-2c7326de96d6 tempest-VolumesActionsTest-514083010 None] Copy volume to image completed successfully. Nov 05 22:20:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2744bb2-8c47-4fae-93a6-54d09e6310ed]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:25 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 Nov 05 22:20:25 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:25 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:25 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 1G Nov 05 22:20:25 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:25 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 1G" returned: 0 in 0.414s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:25 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 Nov 05 22:20:25 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:26 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4" returned: 0 in 0.358s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:26 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 is being set with open permissions: ugo+rw Nov 05 22:20:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:26 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 Nov 05 22:20:26 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:26 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:26 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.info Nov 05 22:20:26 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:26 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.info" returned: 0 in 0.296s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:26 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.info is being set with open permissions: ugo+rw Nov 05 22:20:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:26 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.info Nov 05 22:20:26 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:27 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.info" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.103s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1185022193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ccad61-f8f8-4a01-8f05-ec4326db1a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5901006699b34e60930949925fd0c9df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:58Z,use_quota=True,user_id='3f4a66ef97ac4758afae09c84faccf85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Creating volume 22ccad61-f8f8-4a01-8f05-ec4326db1a66 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:27 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:27 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66 1073741824 Nov 05 22:20:27 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-491c9da1-aa72-4d38-9231-101a66b15936 tempest-SnapshotMetadataTestJSON-1726983323 None] Create snapshot completed successfully Nov 05 22:20:27 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66 1073741824" returned: 0 in 0.424s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:27 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66 Nov 05 22:20:27 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:27 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66" returned: 0 in 0.289s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.075s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea76f570-3613-451e-b006-eaea07db34a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f2f4b2-8bd8-4f0b-b116-0ab25a5b74c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[802cb6fa-d3ad-443b-86e5-4109b46c0ab9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:27 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Volume volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66 (22ccad61-f8f8-4a01-8f05-ec4326db1a66): created successfully Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f2f4b2-8bd8-4f0b-b116-0ab25a5b74c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Flow 'volume_create_manager' (e91a050b-4026-4f51-8745-c9ef2de78f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1c726c3d-d67d-4dea-9641-50d395ecf992 tempest-VolumesServicesTestJSON-558988900 None] Created volume successfully. Nov 05 22:20:28 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 Nov 05 22:20:28 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:28 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97" returned: 0 in 0.538s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Acquiring lock "cinder-22ccad61-f8f8-4a01-8f05-ec4326db1a66-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:28 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee4169e-e821-4b47-ad87-05794037242b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Lock "cinder-22ccad61-f8f8-4a01-8f05-ec4326db1a66-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Acquiring lock "cinder-quobyte-22ccad61-f8f8-4a01-8f05-ec4326db1a66" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Lock "cinder-quobyte-22ccad61-f8f8-4a01-8f05-ec4326db1a66" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:28 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[994ab418-e219-4be4-a505-9cf76888d5e1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:28 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 Nov 05 22:20:28 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:28 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66 Nov 05 22:20:28 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Acquiring lock "cinder-2a14aece-66ef-484b-9bd2-9edf079d0ee4-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:29 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97" returned: 0 in 0.603s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "cinder-2a14aece-66ef-484b-9bd2-9edf079d0ee4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Acquiring lock "cinder-quobyte-37d01c80-0524-40a4-aff2-c2ed82faa5d4" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "cinder-quobyte-37d01c80-0524-40a4-aff2-c2ed82faa5d4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Acquiring lock "cinder-quobyte-2a14aece-66ef-484b-9bd2-9edf079d0ee4" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:29 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img Nov 05 22:20:29 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "cinder-quobyte-2a14aece-66ef-484b-9bd2-9edf079d0ee4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Deleting offline snapshot 2a14aece-66ef-484b-9bd2-9edf079d0ee4 of volume 37d01c80-0524-40a4-aff2-c2ed82faa5d4 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] snapshot_file for this snap is: volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:20:29 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66" returned: 0 in 0.582s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a359bc11-42d5-4a05-b67e-fac0ef5bc248]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:29 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66 Nov 05 22:20:29 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:29 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 Nov 05 22:20:29 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:29 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-22ccad61-f8f8-4a01-8f05-ec4326db1a66" returned: 0 in 0.430s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Lock "cinder-quobyte-22ccad61-f8f8-4a01-8f05-ec4326db1a66" released by "delete_volume" :: held 1.073s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Created reservations ['4b2d6001-6824-424d-b690-60b21e58b222', '11a09fab-f24b-4a72-b7cf-c47aa9c0d588', 'e85da19b-7559-4ee5-9907-2e41a65c9880', '9f783208-9d67-4bbd-ad5c-336e77f7ea91'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:29 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4" returned: 0 in 0.665s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b263b94-fe9a-40ca-8d40-d59bd69c3e87]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:30 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 Nov 05 22:20:30 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:30 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:20:30 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:30 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.537s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Deleted volume successfully. Nov 05 22:20:30 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4" returned: 0 in 0.853s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-be4486e2-9c7d-4ba7-8093-c39e1e498648 tempest-VolumesServicesTestJSON-558988900 None] Lock "cinder-22ccad61-f8f8-4a01-8f05-ec4326db1a66-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:30 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 Nov 05 22:20:30 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:31 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4" returned: 0 in 1.123s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:31 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4 Nov 05 22:20:31 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:32 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4.2a14aece-66ef-484b-9bd2-9edf079d0ee4" returned: 0 in 0.716s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "cinder-quobyte-2a14aece-66ef-484b-9bd2-9edf079d0ee4" released by "_delete_snapshot" :: held 3.644s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "cinder-quobyte-37d01c80-0524-40a4-aff2-c2ed82faa5d4" released by "delete_snapshot" :: held 3.706s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:32 devstack cinder-volume[87122]: WARNING cinder.quota [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:20:33 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Created reservations ['a17425ea-bbbe-46ec-bdcb-ae3ba4c5f6a0', 'd49c55f4-a918-4c9b-ad03-13afce2631b8', 'faa48adc-86e5-423f-a762-dcfd333952eb', '1c81de09-025b-4f9a-a0f8-64be61f8efc1'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Delete snapshot completed successfully. Nov 05 22:20:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-373434c3-196c-4a19-b7b3-fece9cb3b324 tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "cinder-2a14aece-66ef-484b-9bd2-9edf079d0ee4-delete_snapshot" released by "delete_snapshot" :: held 4.153s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Acquiring lock "cinder-37d01c80-0524-40a4-aff2-c2ed82faa5d4-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "cinder-37d01c80-0524-40a4-aff2-c2ed82faa5d4-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Acquiring lock "cinder-quobyte-37d01c80-0524-40a4-aff2-c2ed82faa5d4" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "cinder-quobyte-37d01c80-0524-40a4-aff2-c2ed82faa5d4" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ebe6fe-8023-400b-826d-7af282e7c8a7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:34 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 Nov 05 22:20:34 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:34 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4" returned: 0 in 0.670s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:34 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4 Nov 05 22:20:34 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:35 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-37d01c80-0524-40a4-aff2-c2ed82faa5d4" returned: 0 in 0.563s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "cinder-quobyte-37d01c80-0524-40a4-aff2-c2ed82faa5d4" released by "delete_volume" :: held 1.358s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:35 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Created reservations ['78bb79ba-591e-4bde-b06e-86c49ae46815', '27b414d6-7b33-49ef-845b-16a172111190', 'b8b57b01-729b-45d4-ba62-ac8a5e17f55c', '9e47fe8c-7f12-4693-aaaf-f0bf911694c2'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:35 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:20:35 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:36 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.590s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:36 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Deleted volume successfully. Nov 05 22:20:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5e13323b-5e42-4d72-a60d-8be245f1935e tempest-SnapshotMetadataTestJSON-1726983323 None] Lock "cinder-37d01c80-0524-40a4-aff2-c2ed82faa5d4-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:37 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img" returned: 0 in 8.837s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a294cfb-dff2-454a-b5eb-491f9927edaf]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:37 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 Nov 05 22:20:37 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:38 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97" returned: 0 in 0.591s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:38 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97, size 1024.00 MB, duration 8.84 sec, destination /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:20:38 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Converted 1024.00 MB image at 115.86 MB/s Nov 05 22:20:38 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] 2bcf7f74-6601-4ba7-a95d-67dd129750f2 was raw, converting to qcow2 {{(pid=87122) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 05 22:20:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3f5119-f0ec-4f62-a02b-55326d86ed5a]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:38 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img Nov 05 22:20:38 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:38 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:39 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img Nov 05 22:20:39 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:39 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img" returned: 1 in 0.375s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:20:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img /opt/stack/data/cinder/conversion/vol_upload_4sjsnwqd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:39 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img /opt/stack/data/cinder/conversion/vol_upload_4sjsnwqd Nov 05 22:20:39 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:39 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img /opt/stack/data/cinder/conversion/vol_upload_4sjsnwqd" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:39 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Image conversion details: src /opt/stack/data/cinder/conversion/c25d8028-262f-4f80-ad95-9a1c62a88c97.temp_image.2bcf7f74-6601-4ba7-a95d-67dd129750f2t3kgz9g7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4sjsnwqd {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:20:39 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 22:20:39 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c9c991-e933-4ba9-939a-915276ab64ba]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4sjsnwqd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:39 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4sjsnwqd Nov 05 22:20:39 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:39 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4sjsnwqd" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.156s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Uploaded volume to glance image-id: 2bcf7f74-6601-4ba7-a95d-67dd129750f2. {{(pid=87122) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 22:20:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a3287fc5-0f40-4afc-a68f-9a232136e4b1 tempest-VolumesActionsTest-514083010 None] Copy volume to image completed successfully. Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Flow 'volume_create_manager' (7cccb9ff-c501-45b6-9281-24bf3288e1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf41e3f-b37d-47a5-afe5-19e0c3558a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf41e3f-b37d-47a5-afe5-19e0c3558a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1644678045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77f8abd-e6c8-460b-b34d-e1270f30ce6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377fa108e8594c678b3dec5f828a0840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:42Z,use_quota=True,user_id='20c4d2b1fba74c2db054f89c021bc621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992a04a4-badf-4965-9589-4bf1bf534168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992a04a4-badf-4965-9589-4bf1bf534168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3151b0-8904-467a-adc3-43fb8e503888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3151b0-8904-467a-adc3-43fb8e503888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77f8abd-e6c8-460b-b34d-e1270f30ce6c', 'volume_name': 'volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d0f08c-838c-45bf-b031-fcec6cad9322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d0f08c-838c-45bf-b031-fcec6cad9322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3098ca61-edc3-4ab4-b793-df85624a8bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Volume c77f8abd-e6c8-460b-b34d-e1270f30ce6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c', 'volume_size': 1} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1644678045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77f8abd-e6c8-460b-b34d-e1270f30ce6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377fa108e8594c678b3dec5f828a0840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:42Z,use_quota=True,user_id='20c4d2b1fba74c2db054f89c021bc621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Creating volume c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:42 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:42 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c 1073741824 Nov 05 22:20:42 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Flow 'volume_create_manager' (a588c87f-ccaa-440b-b5b8-dafb49bb4df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85f4c40-7c64-4ee5-a166-0c96230b0dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85f4c40-7c64-4ee5-a166-0c96230b0dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1448339838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3af986-ad90-4473-bcd9-c185018be77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8def40fdff874dd4acea3201b697d447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:42Z,use_quota=True,user_id='4e22951c40b440399528e6fbce95fd0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5473857c-a30f-4744-bba0-f9967551172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5473857c-a30f-4744-bba0-f9967551172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f29546e-d74e-4ebf-ae24-3e074cb73dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f29546e-d74e-4ebf-ae24-3e074cb73dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3af986-ad90-4473-bcd9-c185018be77c', 'volume_name': 'volume-fa3af986-ad90-4473-bcd9-c185018be77c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2093d35e-2704-44d7-8055-8578134d5611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2093d35e-2704-44d7-8055-8578134d5611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9f06dc-f383-4e1e-a4d5-b55af69a9f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Volume fa3af986-ad90-4473-bcd9-c185018be77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3af986-ad90-4473-bcd9-c185018be77c', 'volume_size': 1} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:42 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c 1073741824" returned: 0 in 0.423s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:42 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c Nov 05 22:20:42 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:42 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1448339838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3af986-ad90-4473-bcd9-c185018be77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8def40fdff874dd4acea3201b697d447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:42Z,use_quota=True,user_id='4e22951c40b440399528e6fbce95fd0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Creating volume fa3af986-ad90-4473-bcd9-c185018be77c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:42 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3098ca61-edc3-4ab4-b793-df85624a8bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ecdd2b-36a7-48d0-abb9-770ece0a88c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:42 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c 1073741824 Nov 05 22:20:42 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:43 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Volume volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c (c77f8abd-e6c8-460b-b34d-e1270f30ce6c): created successfully Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ecdd2b-36a7-48d0-abb9-770ece0a88c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Flow 'volume_create_manager' (7cccb9ff-c501-45b6-9281-24bf3288e1f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-caa6c58f-df7f-47e7-a465-b8cc9f0257bc tempest-VolumesDeleteCascade-637328874 None] Created volume successfully. Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Acquiring lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Acquiring lock "cinder-quobyte-c25d8028-262f-4f80-ad95-9a1c62a88c97" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Lock "cinder-quobyte-c25d8028-262f-4f80-ad95-9a1c62a88c97" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:43 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c 1073741824" returned: 0 in 0.722s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[847a63e0-6602-4ad6-9cf1-270eb1308523]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:43 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c Nov 05 22:20:43 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Flow 'volume_create_manager' (0d6e2478-cb22-42a7-958c-c481eb9b5a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:43 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 Nov 05 22:20:43 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8066759b-183e-4f05-ac0e-33ebe7e69382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8066759b-183e-4f05-ac0e-33ebe7e69382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-717309414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d62c0c-1916-4276-a5cb-d544be6a57b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93accf273e024ad2810cef32abc06f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:44Z,use_quota=True,user_id='350628db5309456486ee8247554fe89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505482d0-9da9-4ff4-9334-4951e1f41d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505482d0-9da9-4ff4-9334-4951e1f41d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc934ed2-555e-4712-9230-62103d9c78ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc934ed2-555e-4712-9230-62103d9c78ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d62c0c-1916-4276-a5cb-d544be6a57b0', 'volume_name': 'volume-50d62c0c-1916-4276-a5cb-d544be6a57b0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba68bcb4-4e21-423d-9dfb-98c7f3a476c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba68bcb4-4e21-423d-9dfb-98c7f3a476c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32238d0a-ae58-42f4-b142-f8aad0ba7643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:43 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Volume 50d62c0c-1916-4276-a5cb-d544be6a57b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d62c0c-1916-4276-a5cb-d544be6a57b0', 'volume_size': 1} Nov 05 22:20:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:44 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.138s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-717309414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d62c0c-1916-4276-a5cb-d544be6a57b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93accf273e024ad2810cef32abc06f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:44Z,use_quota=True,user_id='350628db5309456486ee8247554fe89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Creating volume 50d62c0c-1916-4276-a5cb-d544be6a57b0 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:44 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9f06dc-f383-4e1e-a4d5-b55af69a9f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3af986-ad90-4473-bcd9-c185018be77c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:44 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0 1073741824 Nov 05 22:20:44 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3d38be-12ca-415c-aa1e-35d43bb6925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Volume volume-fa3af986-ad90-4473-bcd9-c185018be77c (fa3af986-ad90-4473-bcd9-c185018be77c): created successfully Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3d38be-12ca-415c-aa1e-35d43bb6925c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Flow 'volume_create_manager' (a588c87f-ccaa-440b-b5b8-dafb49bb4df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-73aa6cd6-06a7-41b5-a93d-db7833db3fae tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Created volume successfully. Nov 05 22:20:44 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97" returned: 0 in 0.492s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:44 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97 Nov 05 22:20:44 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:44 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c25d8028-262f-4f80-ad95-9a1c62a88c97" returned: 0 in 0.317s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Lock "cinder-quobyte-c25d8028-262f-4f80-ad95-9a1c62a88c97" released by "delete_volume" :: held 0.862s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Created reservations ['8c34c252-3e92-4d45-ad7a-af040cbb387b', '05302e32-6605-40fa-b881-b24cc630b12b', '8f294ba1-e1c2-4a7a-af78-4606d9a15d3b', '0973f4c3-281a-411d-81dc-7c46e7ea98e8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:44 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0 1073741824" returned: 0 in 0.568s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:44 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0 Nov 05 22:20:44 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:44 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:20:44 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:44 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.470s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32238d0a-ae58-42f4-b142-f8aad0ba7643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d62c0c-1916-4276-a5cb-d544be6a57b0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a96718-b080-4689-93fe-e43b202b889e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Creating offline snapshot 68d39dfd-1e51-4b52-a1cf-e921ab601863 of volume c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:20:44 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:44 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Deleted volume successfully. Nov 05 22:20:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a07c1cd-e164-4a8d-bae1-879ddf832dac]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:45 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Volume volume-50d62c0c-1916-4276-a5cb-d544be6a57b0 (50d62c0c-1916-4276-a5cb-d544be6a57b0): created successfully Nov 05 22:20:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a96718-b080-4689-93fe-e43b202b889e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Flow 'volume_create_manager' (0d6e2478-cb22-42a7-958c-c481eb9b5a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-25085312-e0f5-4a48-af0b-86d131e4a620 tempest-AttachVolumeTestJSON-203979272 None] Created volume successfully. Nov 05 22:20:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b012588-c5e2-498f-94db-e15eb43023aa tempest-VolumesActionsTest-514083010 None] Lock "cinder-c25d8028-262f-4f80-ad95-9a1c62a88c97-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:45 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c Nov 05 22:20:45 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:45 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" returned: 0 in 0.380s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:45 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 1G Nov 05 22:20:45 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:45 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 1G" returned: 0 in 0.494s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:45 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 Nov 05 22:20:45 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:46 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863" returned: 0 in 0.415s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:46 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 is being set with open permissions: ugo+rw Nov 05 22:20:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:46 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 Nov 05 22:20:46 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:46 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863" returned: 0 in 0.281s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:46 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.info Nov 05 22:20:46 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f34695d2-8861-4c41-a292-f2575c7a2f6d req-341289f6-3b1e-4605-b6f5-7c8a183eb1f2 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:46 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.info" returned: 0 in 0.261s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:46 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.info is being set with open permissions: ugo+rw Nov 05 22:20:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:46 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.info Nov 05 22:20:46 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:47 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.info" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.414s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Creating offline snapshot d2d367f6-e8da-4080-b497-2fbaf9698a7a of volume fa3af986-ad90-4473-bcd9-c185018be77c {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:20:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a57971ed-1a60-41e0-a4ac-ee02add65dc4 tempest-VolumesDeleteCascade-637328874 None] Create snapshot completed successfully Nov 05 22:20:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[363a2a45-632a-4d20-9753-4d11f08adcd8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:47 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c Nov 05 22:20:47 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:47 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c" returned: 0 in 0.409s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:47 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a 1G Nov 05 22:20:47 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:48 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a 1G" returned: 0 in 0.407s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3af986-ad90-4473-bcd9-c185018be77c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:48 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3af986-ad90-4473-bcd9-c185018be77c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a Nov 05 22:20:48 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:48 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3af986-ad90-4473-bcd9-c185018be77c -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a" returned: 0 in 0.342s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:48 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a is being set with open permissions: ugo+rw Nov 05 22:20:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:48 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a Nov 05 22:20:48 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:48 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:48 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.info Nov 05 22:20:48 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:48 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.info" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:48 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.info is being set with open permissions: ugo+rw Nov 05 22:20:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:48 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.info Nov 05 22:20:48 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:49 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.info" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f34695d2-8861-4c41-a292-f2575c7a2f6d req-341289f6-3b1e-4605-b6f5-7c8a183eb1f2 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.565s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f34695d2-8861-4c41-a292-f2575c7a2f6d req-341289f6-3b1e-4605-b6f5-7c8a183eb1f2 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.526s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-05ff3bed-93ba-4b2d-9b3c-08738d30dc00 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Create snapshot completed successfully Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] Creating offline snapshot 7dfa1ce7-263d-4d85-ae61-152875190cbf of volume c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe5fa88-a4f6-48b7-9ffd-48d10ba17cca]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f34695d2-8861-4c41-a292-f2575c7a2f6d req-341289f6-3b1e-4605-b6f5-7c8a183eb1f2 tempest-AttachVolumeTestJSON-203979272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-50d62c0c-1916-4276-a5cb-d544be6a57b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23240ccf-153c-4da0-bcc6-cabc767b0ad0', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:20:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-f34695d2-8861-4c41-a292-f2575c7a2f6d req-341289f6-3b1e-4605-b6f5-7c8a183eb1f2 tempest-AttachVolumeTestJSON-203979272 None] attachment_update completed successfully. Nov 05 22:20:49 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 Nov 05 22:20:49 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:49 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863" returned: 0 in 0.467s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:49 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf 1G Nov 05 22:20:49 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:50 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf 1G" returned: 0 in 0.683s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Acquiring lock "cinder-d2d367f6-e8da-4080-b497-2fbaf9698a7a-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:50 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf Nov 05 22:20:50 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "cinder-d2d367f6-e8da-4080-b497-2fbaf9698a7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Acquiring lock "cinder-quobyte-fa3af986-ad90-4473-bcd9-c185018be77c" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "cinder-quobyte-fa3af986-ad90-4473-bcd9-c185018be77c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Acquiring lock "cinder-quobyte-d2d367f6-e8da-4080-b497-2fbaf9698a7a" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "cinder-quobyte-d2d367f6-e8da-4080-b497-2fbaf9698a7a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Deleting offline snapshot d2d367f6-e8da-4080-b497-2fbaf9698a7a of volume fa3af986-ad90-4473-bcd9-c185018be77c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] snapshot_file for this snap is: volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0f1e28-a5df-472f-95ce-4ec371d078dc]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:50 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a Nov 05 22:20:50 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:50 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf" returned: 0 in 0.397s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:50 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf is being set with open permissions: ugo+rw Nov 05 22:20:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:51 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf Nov 05 22:20:51 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:51 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a" returned: 0 in 0.475s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa3af986-ad90-4473-bcd9-c185018be77c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd25796-9f2b-468a-9828-4eddcec44a33]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:51 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:51 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c Nov 05 22:20:51 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d7b51937-3333-4156-b12d-657e79dbb4f1 tempest-VolumesDeleteCascade-637328874 None] Create snapshot completed successfully Nov 05 22:20:51 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c" returned: 0 in 0.449s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:51 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a Nov 05 22:20:51 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-c77f8abd-e6c8-460b-b34d-e1270f30ce6c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-c77f8abd-e6c8-460b-b34d-e1270f30ce6c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Performing cascade delete. {{(pid=87122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-68d39dfd-1e51-4b52-a1cf-e921ab601863-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:52 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-68d39dfd-1e51-4b52-a1cf-e921ab601863-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:52 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a Nov 05 22:20:52 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-68d39dfd-1e51-4b52-a1cf-e921ab601863" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-68d39dfd-1e51-4b52-a1cf-e921ab601863" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Deleting offline snapshot 68d39dfd-1e51-4b52-a1cf-e921ab601863 of volume c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] snapshot_file for this snap is: volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0c3fdc-8395-4795-93fb-d571b4cde0c3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:52 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 Nov 05 22:20:52 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:52 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c.d2d367f6-e8da-4080-b497-2fbaf9698a7a" returned: 0 in 0.279s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "cinder-quobyte-d2d367f6-e8da-4080-b497-2fbaf9698a7a" released by "_delete_snapshot" :: held 1.803s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "cinder-quobyte-fa3af986-ad90-4473-bcd9-c185018be77c" released by "delete_snapshot" :: held 1.837s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Created reservations ['07fbc87a-d9e6-494a-98a6-c6ddb6eaf5b9', 'a1412144-2974-465b-9372-729f9b96e358', 'bbdcf99d-b415-4e17-864a-cc280bab48dd', 'ec5c5111-dfa7-4329-8803-a96b76c15901'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:52 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Delete snapshot completed successfully. Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e8615d0e-cf9c-4084-9520-1fdf5ae06ff2 tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "cinder-d2d367f6-e8da-4080-b497-2fbaf9698a7a-delete_snapshot" released by "delete_snapshot" :: held 2.026s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:52 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863" returned: 0 in 0.449s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[50603eee-efde-4012-8cc1-909d9b68e15d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:52 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c Nov 05 22:20:52 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Acquiring lock "cinder-fa3af986-ad90-4473-bcd9-c185018be77c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "cinder-fa3af986-ad90-4473-bcd9-c185018be77c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Acquiring lock "cinder-quobyte-fa3af986-ad90-4473-bcd9-c185018be77c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "cinder-quobyte-fa3af986-ad90-4473-bcd9-c185018be77c" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Flow 'volume_create_manager' (3124a540-60de-4da6-92c4-45ce0e776c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7efc40c-3740-43fc-bb92-81012694ed26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d5d46e-8087-47c0-ad43-2fe522802726]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7efc40c-3740-43fc-bb92-81012694ed26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1871259052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3d0ce4-6e82-42c9-a100-fc9e720747e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9bc0eaf9144f18b8059a125b5fc70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:53Z,use_quota=True,user_id='ad158619ab7e46ca82d2191c55aed34a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ed5d31-6003-4a79-9a9a-95b4c0e63246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ed5d31-6003-4a79-9a9a-95b4c0e63246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f9e8a4-08af-45ee-9ce9-96e143578fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f9e8a4-08af-45ee-9ce9-96e143578fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d3d0ce4-6e82-42c9-a100-fc9e720747e9', 'volume_name': 'volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a75b2d-f59c-4474-aa47-abc8fdda2fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a75b2d-f59c-4474-aa47-abc8fdda2fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2898509a-23b8-4406-aff9-c10b53e9248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:53 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Volume 8d3d0ce4-6e82-42c9-a100-fc9e720747e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9', 'volume_size': 1} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1871259052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3d0ce4-6e82-42c9-a100-fc9e720747e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9bc0eaf9144f18b8059a125b5fc70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:53Z,use_quota=True,user_id='ad158619ab7e46ca82d2191c55aed34a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Creating volume 8d3d0ce4-6e82-42c9-a100-fc9e720747e9 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:53 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:53 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" returned: 0 in 0.576s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:53 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 1073741824 Nov 05 22:20:53 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:53 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c Nov 05 22:20:53 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4d7e82-84d9-4a37-afda-bb563107771b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:53 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf Nov 05 22:20:53 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:53 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c" returned: 0 in 0.470s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:53 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c Nov 05 22:20:53 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:53 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 1073741824" returned: 0 in 0.513s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:53 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf" returned: 0 in 0.531s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:54 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 Nov 05 22:20:54 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eb7b8d-a822-461f-85cb-2cb9b4cb4caa]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:54 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fa3af986-ad90-4473-bcd9-c185018be77c" returned: 0 in 0.500s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "cinder-quobyte-fa3af986-ad90-4473-bcd9-c185018be77c" released by "delete_volume" :: held 1.122s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:54 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 Nov 05 22:20:54 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Created reservations ['cb01c4c1-7e09-4b38-97ba-df340b6b7450', '8ec7360e-cefe-4e6d-98de-f0538e924006', '2732edf2-c1e7-408f-bca5-712cdbe24b7e', 'f9da618a-07c2-4f44-8ea9-d9c4597bf7ec'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:54 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:20:54 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:54 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9" returned: 0 in 0.686s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2898509a-23b8-4406-aff9-c10b53e9248d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8859655-e989-47f0-a68e-5339a5088c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Volume volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 (8d3d0ce4-6e82-42c9-a100-fc9e720747e9): created successfully Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8859655-e989-47f0-a68e-5339a5088c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Flow 'volume_create_manager' (3124a540-60de-4da6-92c4-45ce0e776c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7c34d05e-f500-4f5d-b26c-e236b88bb07f tempest-VolumesCloneTest-636066496 None] Created volume successfully. Nov 05 22:20:54 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863" returned: 0 in 0.791s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:54 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b65d34c-c334-4ab4-bca6-7141b65f6135]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.419s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Deleted volume successfully. Nov 05 22:20:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-52faec41-4c00-4319-a91d-36f0690e6b5b tempest-VolumeSnapshotQuotasNegativeTestJSON-140153483 None] Lock "cinder-fa3af986-ad90-4473-bcd9-c185018be77c-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:54 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c Nov 05 22:20:54 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:55 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:55 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 Nov 05 22:20:55 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:55 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863" returned: 0 in 0.655s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:55 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863 Nov 05 22:20:55 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:56 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.68d39dfd-1e51-4b52-a1cf-e921ab601863" returned: 0 in 0.441s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf -F qcow2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:56 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf -F qcow2 Nov 05 22:20:56 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Flow 'volume_create_manager' (eeb370ee-1293-42d0-9181-5f55d30bbbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29eae2fb-89bc-4e9b-a6e3-e1cfc230f7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29eae2fb-89bc-4e9b-a6e3-e1cfc230f7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1260446420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d00dda17-a07a-47cf-8152-d24c720cd3a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9bc0eaf9144f18b8059a125b5fc70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8d3d0ce4-6e82-42c9-a100-fc9e720747e9,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:56Z,use_quota=True,user_id='ad158619ab7e46ca82d2191c55aed34a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c859683-5f3e-4bf3-bb94-8a22abc29e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c859683-5f3e-4bf3-bb94-8a22abc29e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a06b95-3032-48e7-ac4a-8e9dd366977a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a06b95-3032-48e7-ac4a-8e9dd366977a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd00dda17-a07a-47cf-8152-d24c720cd3a3', 'volume_name': 'volume-d00dda17-a07a-47cf-8152-d24c720cd3a3', 'volume_size': 2, 'source_volid': '8d3d0ce4-6e82-42c9-a100-fc9e720747e9', 'source_volstatus': 'available'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e36b9fe-3fce-402f-8a13-ccba3b72bab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e36b9fe-3fce-402f-8a13-ccba3b72bab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3dca1a-cba9-441c-815b-1ba33d905cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Volume d00dda17-a07a-47cf-8152-d24c720cd3a3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d00dda17-a07a-47cf-8152-d24c720cd3a3', 'volume_size': 2, 'source_volid': '8d3d0ce4-6e82-42c9-a100-fc9e720747e9', 'source_volstatus': 'available'} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:56 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Cloning volume 8d3d0ce4-6e82-42c9-a100-fc9e720747e9 to volume d00dda17-a07a-47cf-8152-d24c720cd3a3 Nov 05 22:20:56 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf -F qcow2" returned: 0 in 0.576s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-68d39dfd-1e51-4b52-a1cf-e921ab601863" released by "_delete_snapshot" :: held 4.788s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Creating offline snapshot 79cbe118-f31b-4e71-8343-792b751d0886 of volume 8d3d0ce4-6e82-42c9-a100-fc9e720747e9 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" released by "delete_snapshot" :: held 4.830s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[403e0a3d-9a96-47a0-9fc9-290440db0c24]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Created reservations ['1df3b6c9-0d93-4f78-962d-51d35b83e0fd', 'baed12dc-3821-40df-ac7a-1a320f09b0a5', '5689694f-dec2-4e3d-85d7-79cae505760c', '756bfce0-7219-4654-bc9c-5a69ccd89628'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Delete snapshot completed successfully. Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-68d39dfd-1e51-4b52-a1cf-e921ab601863-delete_snapshot" released by "delete_snapshot" :: held 5.072s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-7dfa1ce7-263d-4d85-ae61-152875190cbf-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:57 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 Nov 05 22:20:57 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-7dfa1ce7-263d-4d85-ae61-152875190cbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-7dfa1ce7-263d-4d85-ae61-152875190cbf" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-7dfa1ce7-263d-4d85-ae61-152875190cbf" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Deleting offline snapshot 7dfa1ce7-263d-4d85-ae61-152875190cbf of volume c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] snapshot_file for this snap is: volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82a0ad9-461a-4066-8b7b-b8ac1b0ca1c6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:57 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf Nov 05 22:20:57 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:57 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9" returned: 0 in 0.492s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:57 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 1G Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:20:57 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:57 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:20:57 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:58 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf" returned: 0 in 0.754s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7d953d-fe24-4210-9b6c-26847961d1eb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:58 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.618s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:20:58 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c Nov 05 22:20:58 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:58 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 1G" returned: 0 in 0.988s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:58 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 Nov 05 22:20:58 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:58 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" returned: 0 in 0.718s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:58 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf Nov 05 22:20:58 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:58 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886" returned: 0 in 0.457s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:58 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 is being set with open permissions: ugo+rw Nov 05 22:20:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:59 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 Nov 05 22:20:59 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:59 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf" returned: 0 in 0.483s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:59 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886" returned: 0 in 0.379s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:59 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf Nov 05 22:20:59 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:59 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.info Nov 05 22:20:59 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:59 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c.7dfa1ce7-263d-4d85-ae61-152875190cbf" returned: 0 in 0.380s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-7dfa1ce7-263d-4d85-ae61-152875190cbf" released by "_delete_snapshot" :: held 2.503s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" released by "delete_snapshot" :: held 2.558s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:59 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.info" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:59 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.info is being set with open permissions: ugo+rw Nov 05 22:20:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:59 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Created reservations ['ed3c0816-b8b3-4b9e-bf0d-6373e9c2f55f', '9b98b475-45b3-40e7-8331-1d86e61215d4', '07a33b49-eab8-459d-bcb9-e804df2477fe', '4478f8ec-3f4f-4184-9d04-4369ec3ec5a6'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:59 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.info Nov 05 22:20:59 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Delete snapshot completed successfully. Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-7dfa1ce7-263d-4d85-ae61-152875190cbf-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Snapshots deleted, issuing volume delete {{(pid=87122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2debf3b6-78e2-4a0b-bd90-712302d4570b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:00 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c Nov 05 22:21:00 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:00 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.info" returned: 0 in 0.443s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Acquiring lock "cinder-quobyte-d00dda17-a07a-47cf-8152-d24c720cd3a3" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Lock "cinder-quobyte-d00dda17-a07a-47cf-8152-d24c720cd3a3" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] snapshot: 79cbe118-f31b-4e71-8343-792b751d0886, volume: d00dda17-a07a-47cf-8152-d24c720cd3a3, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cf5340-621e-41b2-86b6-adb6e303468c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:00 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 Nov 05 22:21:00 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:00 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" returned: 0 in 0.605s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:00 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c Nov 05 22:21:00 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:01 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886" returned: 0 in 0.521s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f74290e-f3b9-431d-af13-1be5a35f70fa]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:01 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-c77f8abd-e6c8-460b-b34d-e1270f30ce6c" released by "delete_volume" :: held 0.985s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Created reservations ['69d65f0b-9ebc-4592-8cba-b86eea05cbb0', '0637f55e-362e-4c24-8934-6b02cc470ba8', 'dec645ac-6599-42d0-9255-9999b1e97934', 'aa06a012-04b9-45a5-b580-7a95d5d5be92'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:01 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 Nov 05 22:21:01 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:01 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:21:01 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:01 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:01 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9" returned: 0 in 0.625s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Deleted volume successfully. Nov 05 22:21:01 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 Nov 05 22:21:01 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4a15790-c539-4a77-acb5-cab29fdf184d tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-c77f8abd-e6c8-460b-b34d-e1270f30ce6c-delete_volume" released by "delete_volume" :: held 9.711s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:02 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Flow 'volume_create_manager' (8d5aaa9e-8fd8-47ec-9a58-07261cf50c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e49b5d-237f-483e-aa04-75427d874a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e49b5d-237f-483e-aa04-75427d874a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1554366232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=050c8354-e748-47c1-ac02-048519256ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377fa108e8594c678b3dec5f828a0840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:03Z,use_quota=True,user_id='20c4d2b1fba74c2db054f89c021bc621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c182d34e-b587-4687-86c3-6a7c96f2b0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c182d34e-b587-4687-86c3-6a7c96f2b0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7d6406-d566-4319-bba7-dfcbd7ce4c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7d6406-d566-4319-bba7-dfcbd7ce4c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '050c8354-e748-47c1-ac02-048519256ba3', 'volume_name': 'volume-050c8354-e748-47c1-ac02-048519256ba3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9513d43c-56fb-4ac4-951b-534f99628591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9513d43c-56fb-4ac4-951b-534f99628591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ac6900-ee7f-4e9f-acdd-76a3b697acec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Volume 050c8354-e748-47c1-ac02-048519256ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-050c8354-e748-47c1-ac02-048519256ba3', 'volume_size': 1} Nov 05 22:21:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Flow 'volume_create_manager' (9232ca90-4d22-4321-8f21-997edcfdb0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc000230-4c88-4918-aa8e-be18b832df6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc000230-4c88-4918-aa8e-be18b832df6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1788525070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca240fe979314221be76e841a1325dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:07Z,use_quota=True,user_id='8ef8526245374ff2ac6299b3f68fae40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd665a38-a411-4f3a-ab76-8c815160a299),volume_type_id=dd665a38-a411-4f3a-ab76-8c815160a299)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff7099b-aefe-43c4-9917-2361078c2e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff7099b-aefe-43c4-9917-2361078c2e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435af45a-b8df-4548-9955-b5f0dbf73238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435af45a-b8df-4548-9955-b5f0dbf73238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377', 'volume_name': 'volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5704d65c-38e0-417f-a079-3ad39e688b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5704d65c-38e0-417f-a079-3ad39e688b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d75c7f-05ac-4649-9567-a06e42df9185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Volume 5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377', 'volume_size': 1} Nov 05 22:21:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:10 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3" returned: 0 in 9.138s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:10 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9, size 1024.00 MB, duration 9.14 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:21:10 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Converted 1024.00 MB image at 112.05 MB/s Nov 05 22:21:10 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 is being set with open permissions: ugo+rw Nov 05 22:21:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:10 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 Nov 05 22:21:10 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:11 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Lock "cinder-quobyte-d00dda17-a07a-47cf-8152-d24c720cd3a3" released by "_copy_volume_from_snapshot" :: held 10.633s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Acquiring lock "cinder-quobyte-79cbe118-f31b-4e71-8343-792b751d0886" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Lock "cinder-quobyte-79cbe118-f31b-4e71-8343-792b751d0886" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Deleting offline snapshot 79cbe118-f31b-4e71-8343-792b751d0886 of volume 8d3d0ce4-6e82-42c9-a100-fc9e720747e9 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] snapshot_file for this snap is: volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7d6db-bb78-4948-aa28-8ee4c3ae58ec]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:11 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 Nov 05 22:21:11 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:11 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8270d30e-f09c-4de0-9452-4fd9e628ed11]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:11 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 Nov 05 22:21:11 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:12 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9" returned: 0 in 0.546s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:12 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 Nov 05 22:21:12 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:12 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886" returned: 0 in 0.348s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:12 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886 Nov 05 22:21:12 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:12 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9.79cbe118-f31b-4e71-8343-792b751d0886" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Lock "cinder-quobyte-79cbe118-f31b-4e71-8343-792b751d0886" released by "_delete_snapshot" :: held 1.601s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.819s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.644s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1554366232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=050c8354-e748-47c1-ac02-048519256ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377fa108e8594c678b3dec5f828a0840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:03Z,use_quota=True,user_id='20c4d2b1fba74c2db054f89c021bc621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Creating volume 050c8354-e748-47c1-ac02-048519256ba3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:12 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:12 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 1073741824 Nov 05 22:21:12 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3dca1a-cba9-441c-815b-1ba33d905cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d00dda17-a07a-47cf-8152-d24c720cd3a3', 'volume_size': 2, 'source_volid': '8d3d0ce4-6e82-42c9-a100-fc9e720747e9', 'source_volstatus': 'available'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9d9b41-7634-4269-a1bf-9a4a82563af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:12 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Volume volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 (d00dda17-a07a-47cf-8152-d24c720cd3a3): created successfully Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9d9b41-7634-4269-a1bf-9a4a82563af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:12 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Flow 'volume_create_manager' (eeb370ee-1293-42d0-9181-5f55d30bbbc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-036abf65-8262-47f1-8aed-108fcbd14f42 tempest-VolumesCloneTest-636066496 None] Created volume successfully. Nov 05 22:21:13 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Acquiring lock "cinder-d00dda17-a07a-47cf-8152-d24c720cd3a3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 1073741824" returned: 0 in 0.500s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Lock "cinder-d00dda17-a07a-47cf-8152-d24c720cd3a3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Acquiring lock "cinder-quobyte-d00dda17-a07a-47cf-8152-d24c720cd3a3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:13 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 Nov 05 22:21:13 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Lock "cinder-quobyte-d00dda17-a07a-47cf-8152-d24c720cd3a3" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[014e007b-a315-4ba4-afa4-e0d09aa00a73]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:13 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 Nov 05 22:21:13 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:13 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.881s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1788525070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca240fe979314221be76e841a1325dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:07Z,use_quota=True,user_id='8ef8526245374ff2ac6299b3f68fae40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd665a38-a411-4f3a-ab76-8c815160a299),volume_type_id=dd665a38-a411-4f3a-ab76-8c815160a299)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Creating volume 5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:13 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ac6900-ee7f-4e9f-acdd-76a3b697acec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-050c8354-e748-47c1-ac02-048519256ba3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:13 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 1073741824 Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64555ed9-4cef-49d6-990b-5eff42349c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:13 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Volume volume-050c8354-e748-47c1-ac02-048519256ba3 (050c8354-e748-47c1-ac02-048519256ba3): created successfully Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64555ed9-4cef-49d6-990b-5eff42349c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Flow 'volume_create_manager' (8d5aaa9e-8fd8-47ec-9a58-07261cf50c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e7758280-0e5b-4a5c-8f5e-3c0e88c6ebad tempest-VolumesDeleteCascade-637328874 None] Created volume successfully. Nov 05 22:21:13 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:13 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3 Nov 05 22:21:13 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:13 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d00dda17-a07a-47cf-8152-d24c720cd3a3" returned: 0 in 0.270s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Lock "cinder-quobyte-d00dda17-a07a-47cf-8152-d24c720cd3a3" released by "delete_volume" :: held 0.680s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Created reservations ['594ade32-7cf3-40b3-aa96-868efb3bb0da', '45a90a03-a296-4357-acf2-ec1d30b01267', 'a2498625-70c3-4f3e-81cd-8c0364de149e', 'f7543f50-9d8f-45a1-93cc-b3fd065e8199'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:14 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 1073741824" returned: 0 in 0.595s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:14 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:21:14 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:14 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 Nov 05 22:21:14 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:14 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Deleted volume successfully. Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Acquiring lock "cinder-8d3d0ce4-6e82-42c9-a100-fc9e720747e9-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:14 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-391b36c0-c829-48fa-a22e-769621742975 tempest-VolumesCloneTest-636066496 None] Lock "cinder-d00dda17-a07a-47cf-8152-d24c720cd3a3-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.328s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Lock "cinder-8d3d0ce4-6e82-42c9-a100-fc9e720747e9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d75c7f-05ac-4649-9567-a06e42df9185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7684deb6-5545-4726-9cfa-b29c68387551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Creating offline snapshot 9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e of volume 050c8354-e748-47c1-ac02-048519256ba3 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:21:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Volume volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 (5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377): created successfully Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7684deb6-5545-4726-9cfa-b29c68387551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Flow 'volume_create_manager' (9232ca90-4d22-4321-8f21-997edcfdb0fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce508a83-b03d-4776-854e-b6eab483dd9d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f159fb13-adc4-48b8-a443-b11f336e0ff0 tempest-VolumeTypesAccessTest-386006297 None] Created volume successfully. Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Acquiring lock "cinder-quobyte-8d3d0ce4-6e82-42c9-a100-fc9e720747e9" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Lock "cinder-quobyte-8d3d0ce4-6e82-42c9-a100-fc9e720747e9" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d610cc63-c5f2-48e9-b1f6-d5abc928eb9f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:14 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 Nov 05 22:21:14 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:14 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 Nov 05 22:21:14 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:14 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3" returned: 0 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:14 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e 1G Nov 05 22:21:14 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:15 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9" returned: 0 in 0.391s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:15 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9 Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Acquiring lock "cinder-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:15 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Lock "cinder-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Acquiring lock "cinder-quobyte-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Lock "cinder-quobyte-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eb00e8-0989-45c0-a572-d8c1c0fe392a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:15 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 Nov 05 22:21:15 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:15 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8d3d0ce4-6e82-42c9-a100-fc9e720747e9" returned: 0 in 0.326s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:15 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e 1G" returned: 0 in 0.441s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050c8354-e748-47c1-ac02-048519256ba3 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Lock "cinder-quobyte-8d3d0ce4-6e82-42c9-a100-fc9e720747e9" released by "delete_volume" :: held 0.791s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:15 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050c8354-e748-47c1-ac02-048519256ba3 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e Nov 05 22:21:15 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Created reservations ['0331901b-d93c-4bc9-a2c6-dc2d840af9e8', '85f30b32-12f8-42ed-8d9d-08be6d7f8b73', '638865ec-eba7-41ac-9df7-79e65c4b3990', '528fde09-c32e-4e79-ad31-975a4eac0d3c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:15 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:21:15 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:15 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377" returned: 0 in 0.447s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:15 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377 Nov 05 22:21:15 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:15 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050c8354-e748-47c1-ac02-048519256ba3 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:15 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e is being set with open permissions: ugo+rw Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:15 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e Nov 05 22:21:15 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:15 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Deleted volume successfully. Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a08b30e8-45b6-447d-be66-d2a9329af40d tempest-VolumesCloneTest-636066496 None] Lock "cinder-8d3d0ce4-6e82-42c9-a100-fc9e720747e9-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:15 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Lock "cinder-quobyte-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377" released by "delete_volume" :: held 0.774s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:15 devstack cinder-volume[87122]: WARNING cinder.quota [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1289976147 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1289976147, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:21:15 devstack cinder-volume[87122]: WARNING cinder.quota [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1289976147 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1289976147, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:21:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Created reservations ['8d054eae-82b9-4a49-a25f-7b8b74125057', '10947dff-86a7-4b97-b912-74926e0baf9d', '374c75b0-e3fd-4144-aa39-50dabe4a815b', 'b8c53d96-4206-4828-9231-5e49c259370e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:16 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e" returned: 0 in 0.286s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:16 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:21:16 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:16 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.info Nov 05 22:21:16 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:16 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.293s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Deleted volume successfully. Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8a3fe38b-9140-497c-8106-8ecd24986ad5 tempest-VolumeTypesAccessTest-386006297 None] Lock "cinder-5d8aeb8f-a2a4-47b7-85b7-d2a2a7be7377-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:16 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.info" returned: 0 in 0.311s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:16 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.info is being set with open permissions: ugo+rw Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:16 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.info Nov 05 22:21:16 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:16 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.info" returned: 0 in 0.318s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-04bc0358-0cd6-410e-a022-89c99fa90145 tempest-VolumesDeleteCascade-637328874 None] Create snapshot completed successfully Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Flow 'volume_create_manager' (2e1ade3b-107a-427b-8568-71ade1ac0e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9527565-5c8c-434d-a4fd-a4bc5c9832ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9527565-5c8c-434d-a4fd-a4bc5c9832ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-741098737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28baffbf-f325-4f47-8889-92a9a76be7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377fa108e8594c678b3dec5f828a0840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:18Z,use_quota=True,user_id='20c4d2b1fba74c2db054f89c021bc621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac49c303-bbd7-4316-8d38-768ca7b07a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac49c303-bbd7-4316-8d38-768ca7b07a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3462be-d6a7-4a44-8b39-dbdc6f80ee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3462be-d6a7-4a44-8b39-dbdc6f80ee58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28baffbf-f325-4f47-8889-92a9a76be7a3', 'volume_name': 'volume-28baffbf-f325-4f47-8889-92a9a76be7a3', 'volume_size': 1, 'snapshot_id': '9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dbad387-840e-4c82-b4ce-c74a43b0d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dbad387-840e-4c82-b4ce-c74a43b0d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c192d4-bb2f-4f3e-ae23-7e6350231a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Volume 28baffbf-f325-4f47-8889-92a9a76be7a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28baffbf-f325-4f47-8889-92a9a76be7a3', 'volume_size': 1, 'snapshot_id': '9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e'} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e-28baffbf-f325-4f47-8889-92a9a76be7a3" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e-28baffbf-f325-4f47-8889-92a9a76be7a3" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Creating volume 28baffbf-f325-4f47-8889-92a9a76be7a3 from snapshot 9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-28baffbf-f325-4f47-8889-92a9a76be7a3" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-28baffbf-f325-4f47-8889-92a9a76be7a3" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] snapshot: 9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e, volume: 28baffbf-f325-4f47-8889-92a9a76be7a3, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6154219d-4247-4dc9-a19e-412fac8265ba]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:18 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e Nov 05 22:21:18 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:19 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e" returned: 0 in 0.641s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050c8354-e748-47c1-ac02-048519256ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:19 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5beb8a-1ed2-4740-8e6e-d957fcd50c25]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:19 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 Nov 05 22:21:19 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:19 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3" returned: 0 in 0.433s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:21:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:21:19 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:21:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:19 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 Nov 05 22:21:19 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-599578cd-3cf8-453c-86fd-49de2018714d req-0622de78-d5b7-4b05-848e-3a08964a47cf tempest-AttachVolumeTestJSON-203979272 None] Terminate volume connection completed successfully. Nov 05 22:21:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-599578cd-3cf8-453c-86fd-49de2018714d req-0622de78-d5b7-4b05-848e-3a08964a47cf tempest-AttachVolumeTestJSON-203979272 None] Deleting attachment 23240ccf-153c-4da0-bcc6-cabc767b0ad0. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Flow 'volume_create_manager' (783bda3c-bfe0-4be7-916d-40357307c817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a48f09-2f78-46ad-8ce0-1bf6839d560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a48f09-2f78-46ad-8ce0-1bf6839d560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2054630184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55da8441-3dfb-4867-8dde-9d298a313eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23367e16a964b31b6f4668ca91ad99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:21Z,use_quota=True,user_id='0f89fc2fcd5848cc8969b254ee51faf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51714400-f5ad-4a68-9045-a515a739054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51714400-f5ad-4a68-9045-a515a739054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5399946d-218e-460e-a8e1-407dc8d291dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5399946d-218e-460e-a8e1-407dc8d291dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55da8441-3dfb-4867-8dde-9d298a313eff', 'volume_name': 'volume-55da8441-3dfb-4867-8dde-9d298a313eff', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef896311-32a0-46c0-a454-ae9de9d75dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef896311-32a0-46c0-a454-ae9de9d75dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522f3fd3-bdef-4b36-8819-6bce69231011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Volume 55da8441-3dfb-4867-8dde-9d298a313eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55da8441-3dfb-4867-8dde-9d298a313eff', 'volume_size': 1} Nov 05 22:21:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:29 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3" returned: 0 in 10.317s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:29 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3, size 1024.00 MB, duration 10.32 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:21:29 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Converted 1024.00 MB image at 99.24 MB/s Nov 05 22:21:29 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 is being set with open permissions: ugo+rw Nov 05 22:21:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:30 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 Nov 05 22:21:30 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:30 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-28baffbf-f325-4f47-8889-92a9a76be7a3" released by "_copy_volume_from_snapshot" :: held 11.867s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=106,cinder:UPDATE=124,cinder:INSERT=26,cinder:DELETE=11 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=120,cinder:SELECT=113,cinder:INSERT=36,cinder:DELETE=10 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e-28baffbf-f325-4f47-8889-92a9a76be7a3" released by "_create_volume_from_snapshot" :: held 11.974s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.996s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.556s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2054630184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55da8441-3dfb-4867-8dde-9d298a313eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23367e16a964b31b6f4668ca91ad99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:21Z,use_quota=True,user_id='0f89fc2fcd5848cc8969b254ee51faf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Creating volume 55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:30 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:30 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff 1073741824 Nov 05 22:21:30 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c192d4-bb2f-4f3e-ae23-7e6350231a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28baffbf-f325-4f47-8889-92a9a76be7a3', 'volume_size': 1, 'snapshot_id': '9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6f759a-9194-481c-a829-83f0d8d1136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Volume volume-28baffbf-f325-4f47-8889-92a9a76be7a3 (28baffbf-f325-4f47-8889-92a9a76be7a3): created successfully Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6f759a-9194-481c-a829-83f0d8d1136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Flow 'volume_create_manager' (2e1ade3b-107a-427b-8568-71ade1ac0e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f2dda8c2-6319-4190-99e0-21ddc1ab4e9b tempest-VolumesDeleteCascade-637328874 None] Created volume successfully. Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-050c8354-e748-47c1-ac02-048519256ba3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-050c8354-e748-47c1-ac02-048519256ba3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Performing cascade delete. {{(pid=87122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-050c8354-e748-47c1-ac02-048519256ba3" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-050c8354-e748-47c1-ac02-048519256ba3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Deleting offline snapshot 9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e of volume 050c8354-e748-47c1-ac02-048519256ba3 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:21:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] snapshot_file for this snap is: volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1953bbc-3008-4289-bcf6-e4cf11927570]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:31 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff 1073741824" returned: 0 in 0.704s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:31 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e Nov 05 22:21:31 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:31 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff Nov 05 22:21:31 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:31 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff" returned: 0 in 0.399s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522f3fd3-bdef-4b36-8819-6bce69231011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55da8441-3dfb-4867-8dde-9d298a313eff', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcf2562-652f-4f6d-b63d-07502b39d4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Volume volume-55da8441-3dfb-4867-8dde-9d298a313eff (55da8441-3dfb-4867-8dde-9d298a313eff): created successfully Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcf2562-652f-4f6d-b63d-07502b39d4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Flow 'volume_create_manager' (783bda3c-bfe0-4be7-916d-40357307c817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0899b3ac-d480-4536-8d8c-8753ecc8eafb tempest-VolumesSnapshotListTestJSON-1926735139 None] Created volume successfully. Nov 05 22:21:31 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e" returned: 0 in 0.702s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050c8354-e748-47c1-ac02-048519256ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee8e94b-2bec-4099-9535-ab2368303db6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:31 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 Nov 05 22:21:31 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:32 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3" returned: 0 in 0.640s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:32 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e Nov 05 22:21:32 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Creating offline snapshot 6237a69a-bd65-4fe1-a2d9-fca7c369abf8 of volume 55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:21:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da90bbf-0956-46a7-accb-0d5ff3eb1e8b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:32 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e" returned: 0 in 0.444s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:32 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e Nov 05 22:21:32 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:32 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff Nov 05 22:21:32 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:33 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3.9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:33 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e" released by "_delete_snapshot" :: held 2.310s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff" returned: 0 in 0.458s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-050c8354-e748-47c1-ac02-048519256ba3" released by "delete_snapshot" :: held 2.347s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:33 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 1G Nov 05 22:21:33 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Created reservations ['ec38a3b8-fa91-447f-94e4-de0acb121683', 'ef4ca79e-8984-448b-8ccf-c15db4add17b', 'e1e3d8da-c8a9-4679-8f5a-9193721b5119', '4b40d5ec-e90c-4fd8-b30f-53f52888404f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Delete snapshot completed successfully. Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-9a3d23d3-e8a4-4966-b84e-77a48c5a2b1e-delete_snapshot" released by "delete_snapshot" :: held 2.536s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Snapshots deleted, issuing volume delete {{(pid=87122) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-050c8354-e748-47c1-ac02-048519256ba3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-050c8354-e748-47c1-ac02-048519256ba3" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f341d1a-15f6-4bf0-a3e4-42508cb25e56]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:33 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 Nov 05 22:21:33 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:33 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 1G" returned: 0 in 0.478s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55da8441-3dfb-4867-8dde-9d298a313eff -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:33 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55da8441-3dfb-4867-8dde-9d298a313eff -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 Nov 05 22:21:33 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:33 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:34 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3 Nov 05 22:21:34 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:34 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55da8441-3dfb-4867-8dde-9d298a313eff -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8" returned: 0 in 0.518s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:34 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 is being set with open permissions: ugo+rw Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:34 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050c8354-e748-47c1-ac02-048519256ba3" returned: 0 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:34 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 Nov 05 22:21:34 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-050c8354-e748-47c1-ac02-048519256ba3" released by "delete_volume" :: held 0.887s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Created reservations ['de60a806-9d1e-460f-b8ba-c150e63168f9', '5256731d-6adc-492e-b9cf-5b1d150edbdd', 'ad57afd3-a495-4af3-9221-b1f49b79856e', '2d1646cf-4803-4b8f-adcd-22515a274baa'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:34 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:21:34 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:34 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8" returned: 0 in 0.357s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:34 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.info Nov 05 22:21:34 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:34 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.322s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Deleted volume successfully. Nov 05 22:21:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b60f2761-a03e-4944-a99c-2d6dd4ee9279 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-050c8354-e748-47c1-ac02-048519256ba3-delete_volume" released by "delete_volume" :: held 4.109s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:35 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.info" returned: 0 in 0.379s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:35 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.info is being set with open permissions: ugo+rw Nov 05 22:21:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:35 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.info Nov 05 22:21:35 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:35 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.info" returned: 0 in 0.330s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-28baffbf-f325-4f47-8889-92a9a76be7a3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-daf93955-20e8-41b9-911b-089601546999 tempest-VolumesSnapshotListTestJSON-1926735139 None] Create snapshot completed successfully Nov 05 22:21:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-28baffbf-f325-4f47-8889-92a9a76be7a3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "cinder-quobyte-28baffbf-f325-4f47-8889-92a9a76be7a3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-28baffbf-f325-4f47-8889-92a9a76be7a3" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff83a3ca-cab2-4e5f-bcea-87fb8bca9b61]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:35 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 Nov 05 22:21:35 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:36 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3" returned: 0 in 0.443s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:36 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3 Nov 05 22:21:36 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] Creating offline snapshot c587667c-d111-412b-981f-b8b218d73f51 of volume 55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4bdbf1-f80a-40a3-9f5d-c27c0f2ec021]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:36 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-28baffbf-f325-4f47-8889-92a9a76be7a3" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-quobyte-28baffbf-f325-4f47-8889-92a9a76be7a3" released by "delete_volume" :: held 0.817s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Created reservations ['77e0d564-4fe1-4868-8907-429e89581508', 'c47e48df-1c1a-4485-8e9f-77e803197b1e', '14d1b4be-59ee-4f44-9ae4-8d9b0209c736', '13f4a5eb-62c7-4d50-bf84-c522d73aa7e3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:36 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 Nov 05 22:21:36 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:36 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:21:36 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:36 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8" returned: 0 in 0.572s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55da8441-3dfb-4867-8dde-9d298a313eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:37 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 1G Nov 05 22:21:37 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:37 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.495s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:37 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Deleted volume successfully. Nov 05 22:21:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-60e9aa25-0255-47d6-84e2-138ab5bca862 tempest-VolumesDeleteCascade-637328874 None] Lock "cinder-28baffbf-f325-4f47-8889-92a9a76be7a3-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:37 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 1G" returned: 0 in 0.603s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:37 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 Nov 05 22:21:37 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:37 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51" returned: 0 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:37 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 is being set with open permissions: ugo+rw Nov 05 22:21:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:37 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 Nov 05 22:21:37 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:38 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51" returned: 0 in 0.418s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.228s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8a7f2566-1fe5-4360-9a23-acffb7bc308f tempest-VolumesSnapshotListTestJSON-1926735139 None] Create snapshot completed successfully Nov 05 22:21:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] Creating offline snapshot 5666650c-437a-4019-b3d6-2b44e6988d07 of volume 55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:21:39 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[751dd82c-19d2-4a8f-8cee-a1298200fff8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:39 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 Nov 05 22:21:39 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:40 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51" returned: 0 in 0.501s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55da8441-3dfb-4867-8dde-9d298a313eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:40 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 1G Nov 05 22:21:40 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:40 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 1G" returned: 0 in 0.616s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:40 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 Nov 05 22:21:40 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:41 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07" returned: 0 in 0.404s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:41 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 is being set with open permissions: ugo+rw Nov 05 22:21:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:41 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 Nov 05 22:21:41 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:41 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07" returned: 0 in 0.324s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b694e90e-7921-4f14-9dc9-f483a349e777 tempest-VolumesSnapshotListTestJSON-1926735139 None] Create snapshot completed successfully Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Flow 'volume_create_manager' (bd6e4bf1-d029-4cbd-ac89-c701cca940ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8edaca0-dd4b-484c-b667-c1d4637ab3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8edaca0-dd4b-484c-b667-c1d4637ab3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2140521985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e58e475ffff4ea6ac2ae198061790ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:42Z,use_quota=True,user_id='f26eb9b88ce049f5bbe6cdf82de95c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108735d5-f72c-43b2-ace7-57a1b3a7cfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108735d5-f72c-43b2-ace7-57a1b3a7cfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6304aa-1f4a-4974-987c-b42ecdfc18e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6304aa-1f4a-4974-987c-b42ecdfc18e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e', 'volume_name': 'volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d043ba0-d6af-43a2-8933-b8fd2971f781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d043ba0-d6af-43a2-8933-b8fd2971f781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88469bcd-6df0-42cd-9c26-046e8773be4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Volume 02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 22:21:42 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Trying to clone 02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e from image a030b230-32ee-42bd-ba4c-7115346087a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:21:43 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Image download 20.69 MB at 20.69 MB/s Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[583bcc4c-00f0-4b96-bdf3-f7001cae5375]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-5666650c-437a-4019-b3d6-2b44e6988d07-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-5666650c-437a-4019-b3d6-2b44e6988d07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-quobyte-5666650c-437a-4019-b3d6-2b44e6988d07" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-5666650c-437a-4019-b3d6-2b44e6988d07" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Deleting offline snapshot 5666650c-437a-4019-b3d6-2b44e6988d07 of volume 55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] snapshot_file for this snap is: volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6c5b69-9391-49a7-80b3-7b92c2f887fb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:43 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD Nov 05 22:21:43 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:43 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 Nov 05 22:21:43 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:43 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Temporary image a030b230-32ee-42bd-ba4c-7115346087a9 is fetched for user f26eb9b88ce049f5bbe6cdf82de95c50. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a6115b-79d5-4b60-9a96-54f075278b76]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:43 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07" returned: 0 in 0.451s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55da8441-3dfb-4867-8dde-9d298a313eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fda08d-bccd-41da-9b5a-6abb373c8366]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:43 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD Nov 05 22:21:43 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:43 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 Nov 05 22:21:43 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:44 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2140521985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e58e475ffff4ea6ac2ae198061790ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:42Z,use_quota=True,user_id='f26eb9b88ce049f5bbe6cdf82de95c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Creating volume 02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:44 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:44 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e 1073741824 Nov 05 22:21:44 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:44 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51" returned: 0 in 0.422s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55da8441-3dfb-4867-8dde-9d298a313eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:44 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 Nov 05 22:21:44 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:44 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e 1073741824" returned: 0 in 0.563s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:44 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e Nov 05 22:21:44 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:44 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07" returned: 0 in 0.540s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:44 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07 Nov 05 22:21:44 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:44 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:44 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Attempting download of a030b230-32ee-42bd-ba4c-7115346087a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}])) to volume 02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:21:45 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.5666650c-437a-4019-b3d6-2b44e6988d07" returned: 0 in 0.325s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d4bd55-7cbe-40b5-974c-e67296765b85]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_9bbqxgcx {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-5666650c-437a-4019-b3d6-2b44e6988d07" released by "_delete_snapshot" :: held 1.896s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" released by "delete_snapshot" :: held 1.930s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Created reservations ['db794228-8583-42cf-9b99-7f2220da02aa', '05738ee9-7eb8-4aef-8aac-7798b0ff8a9d', '41612327-e7d6-4750-bca6-3ac0cdf7f8a9', 'b16a4f1d-26ac-48fc-981b-2387dd2e6252'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:45 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_9bbqxgcx Nov 05 22:21:45 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Delete snapshot completed successfully. Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a334b32d-c6b4-4869-a7fd-da51b0e5775d tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-5666650c-437a-4019-b3d6-2b44e6988d07-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-c587667c-d111-412b-981f-b8b218d73f51-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-c587667c-d111-412b-981f-b8b218d73f51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-quobyte-c587667c-d111-412b-981f-b8b218d73f51" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-c587667c-d111-412b-981f-b8b218d73f51" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Deleting offline snapshot c587667c-d111-412b-981f-b8b218d73f51 of volume 55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] snapshot_file for this snap is: volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbf72bc-0c4d-4d2b-a79f-9f602d926703]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:45 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_9bbqxgcx" returned: 0 in 0.416s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_9bbqxgcx {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:45 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 Nov 05 22:21:45 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:45 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_9bbqxgcx Nov 05 22:21:45 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:45 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:45 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55da8441-3dfb-4867-8dde-9d298a313eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_9bbqxgcx" returned: 1 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_9bbqxgcx' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11ca8b1-1a67-45f6-860d-c7e7f9409dd1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e133a067-d4ba-49c3-8bd1-5cae20ec3bd8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:45 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD Nov 05 22:21:45 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:46 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 Nov 05 22:21:46 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:46 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:46 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] a030b230-32ee-42bd-ba4c-7115346087a9 was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:21:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:46 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e Nov 05 22:21:46 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:46 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55da8441-3dfb-4867-8dde-9d298a313eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:46 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 Nov 05 22:21:46 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:46 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51" returned: 0 in 0.400s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:46 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51 Nov 05 22:21:46 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:46 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.c587667c-d111-412b-981f-b8b218d73f51" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-c587667c-d111-412b-981f-b8b218d73f51" released by "_delete_snapshot" :: held 1.591s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" released by "delete_snapshot" :: held 1.625s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Created reservations ['6fc982c9-b4d4-497e-bc75-2bf01b86583a', 'fc9b079d-fa3a-4a80-b20d-95ed254a2559', '3b514a5a-830a-4a54-b8c1-e3374a2a4017', '215fc443-9007-4a67-ab02-662e32433604'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Delete snapshot completed successfully. Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6500ac05-58ed-42b9-ae07-232e77a27fea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-c587667c-d111-412b-981f-b8b218d73f51-delete_snapshot" released by "delete_snapshot" :: held 1.804s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Flow 'volume_create_manager' (0016fc1d-8867-43ba-80a5-f0332e6527b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f41494-37f3-4c20-a23e-7bfa608fc2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-6237a69a-bd65-4fe1-a2d9-fca7c369abf8-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f41494-37f3-4c20-a23e-7bfa608fc2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1859595312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1fbb3b-34bb-4f34-a882-3db440e828e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59deddd66374f68a4e0179d2714b0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:47Z,use_quota=True,user_id='864d9bc7431245baba4a9c3a89ec6b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c19e70f-808b-45ae-b49c-a7db24138392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c19e70f-808b-45ae-b49c-a7db24138392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215c1faf-679a-4318-bece-d7e52cf10523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215c1faf-679a-4318-bece-d7e52cf10523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1fbb3b-34bb-4f34-a882-3db440e828e8', 'volume_name': 'volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2cd957-e886-464b-b955-b1ea2d8f0803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2cd957-e886-464b-b955-b1ea2d8f0803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7e8420-8d7f-4995-85d9-8a5cff82ded8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Volume 8a1fbb3b-34bb-4f34-a882-3db440e828e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8', 'volume_size': 1} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1859595312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1fbb3b-34bb-4f34-a882-3db440e828e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59deddd66374f68a4e0179d2714b0f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:47Z,use_quota=True,user_id='864d9bc7431245baba4a9c3a89ec6b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Creating volume 8a1fbb3b-34bb-4f34-a882-3db440e828e8 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:47 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:47 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8 1073741824 Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-6237a69a-bd65-4fe1-a2d9-fca7c369abf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.096s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:47 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-quobyte-6237a69a-bd65-4fe1-a2d9-fca7c369abf8" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-6237a69a-bd65-4fe1-a2d9-fca7c369abf8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Deleting offline snapshot 6237a69a-bd65-4fe1-a2d9-fca7c369abf8 of volume 55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] snapshot_file for this snap is: volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72c8e27-da05-473c-b206-15d89a3c4f32]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:47 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 Nov 05 22:21:47 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:48 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8 1073741824" returned: 0 in 0.484s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:48 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8" returned: 0 in 0.404s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55da8441-3dfb-4867-8dde-9d298a313eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e31694-6b86-4eb3-994c-e731490de472]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:48 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8 Nov 05 22:21:48 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:48 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e" returned: 0 in 1.992s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_4szanc1ndevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:21:48 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Converted 112.00 MB image at 56.19 MB/s Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:48 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e 1G Nov 05 22:21:48 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:48 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff Nov 05 22:21:48 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:48 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7e8420-8d7f-4995-85d9-8a5cff82ded8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e273d8b9-4d28-434e-a695-47c2e1731462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:48 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Volume volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8 (8a1fbb3b-34bb-4f34-a882-3db440e828e8): created successfully Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e273d8b9-4d28-434e-a695-47c2e1731462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Flow 'volume_create_manager' (0016fc1d-8867-43ba-80a5-f0332e6527b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-10b48724-479e-469a-b1a6-7701ed138293 tempest-AbsoluteLimitsTests-1733790390 None] Created volume successfully. Nov 05 22:21:48 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:48 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e 1G" returned: 0 in 0.337s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Downloaded image a030b230-32ee-42bd-ba4c-7115346087a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}])) to volume 02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:21:48 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Temporary image a030b230-32ee-42bd-ba4c-7115346087a9 for user f26eb9b88ce049f5bbe6cdf82de95c50 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:21:48 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Marking volume 02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Copying metadata from image a030b230-32ee-42bd-ba4c-7115346087a9 to 02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Creating volume glance metadata for volume 02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e backed by image a030b230-32ee-42bd-ba4c-7115346087a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88469bcd-6df0-42cd-9c26-046e8773be4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc80950c-bdeb-4fc3-9907-4607ab3abf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:48 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Volume volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e (02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e): created successfully Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc80950c-bdeb-4fc3-9907-4607ab3abf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Flow 'volume_create_manager' (bd6e4bf1-d029-4cbd-ac89-c701cca940ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-03d7ca03-7b9f-42d6-bc26-1a479cd72eeb tempest-VolumesExtendTest-199926380 None] Created volume successfully. Nov 05 22:21:48 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:48 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8 Nov 05 22:21:48 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:49 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff.6237a69a-bd65-4fe1-a2d9-fca7c369abf8" returned: 0 in 0.227s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-6237a69a-bd65-4fe1-a2d9-fca7c369abf8" released by "_delete_snapshot" :: held 1.481s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" released by "delete_snapshot" :: held 1.505s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Created reservations ['e6939de4-de15-4abf-94c5-a9a2b14b84af', '926b5d93-e93f-4860-9b55-6868d4c5abf5', '436b3eef-48a8-4e5e-9c2d-7ab5d658f583', '7981d831-dc34-4275-be05-4c2e5572df22'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Delete snapshot completed successfully. Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c24f50e7-217f-4aef-ab63-1673361c829b tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-6237a69a-bd65-4fe1-a2d9-fca7c369abf8-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Acquiring lock "cinder-8a1fbb3b-34bb-4f34-a882-3db440e828e8-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6b5bdfb4-2ea7-48e2-bdb7-90132c44bb60 tempest-VolumesExtendTest-199926380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6b5bdfb4-2ea7-48e2-bdb7-90132c44bb60 tempest-VolumesExtendTest-199926380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Lock "cinder-8a1fbb3b-34bb-4f34-a882-3db440e828e8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5189b461-4b01-4d04-9a07-b184e1ae8bc6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6b5bdfb4-2ea7-48e2-bdb7-90132c44bb60 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Acquiring lock "cinder-quobyte-8a1fbb3b-34bb-4f34-a882-3db440e828e8" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Lock "cinder-quobyte-8a1fbb3b-34bb-4f34-a882-3db440e828e8" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-55da8441-3dfb-4867-8dde-9d298a313eff-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9739bbb9-a5f0-4770-9211-db0f2dcd1a00]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-55da8441-3dfb-4867-8dde-9d298a313eff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:49 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e Nov 05 22:21:49 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd423d6-d703-42a2-b9e3-617ec23661f9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:50 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8 Nov 05 22:21:50 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:50 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff Nov 05 22:21:50 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:50 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6b5bdfb4-2ea7-48e2-bdb7-90132c44bb60 tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e" returned: 0 in 0.512s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6b5bdfb4-2ea7-48e2-bdb7-90132c44bb60 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e 2G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:50 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8" returned: 0 in 0.471s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6b5bdfb4-2ea7-48e2-bdb7-90132c44bb60 tempest-VolumesExtendTest-199926380 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e 2G" returned: 0 in 0.105s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:50 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8 Nov 05 22:21:50 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6b5bdfb4-2ea7-48e2-bdb7-90132c44bb60 tempest-VolumesExtendTest-199926380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.687s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6b5bdfb4-2ea7-48e2-bdb7-90132c44bb60 tempest-VolumesExtendTest-199926380 None] Extend volume completed successfully. Nov 05 22:21:50 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff" returned: 0 in 0.475s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:50 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff Nov 05 22:21:50 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:50 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a1fbb3b-34bb-4f34-a882-3db440e828e8" returned: 0 in 0.285s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Lock "cinder-quobyte-8a1fbb3b-34bb-4f34-a882-3db440e828e8" released by "delete_volume" :: held 0.826s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Created reservations ['b31f7da1-6470-40ae-b2d1-cc97054cfe22', 'ac38f67d-331e-42e9-914c-42dc104a1c8d', 'f1d71b6d-3147-4eae-a5ee-b58d949aabf6', '815e58ff-8b33-410f-a9bb-4a174a8f362f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:50 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-55da8441-3dfb-4867-8dde-9d298a313eff" returned: 0 in 0.267s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-quobyte-55da8441-3dfb-4867-8dde-9d298a313eff" released by "delete_volume" :: held 0.822s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:50 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:21:50 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Created reservations ['13d52360-412c-4fa5-aee2-34d65186cc56', '97080f83-ac66-487b-943e-0ee883902c51', '965fffde-0f8c-4721-81a8-47c143e518da', 'c16cbf4f-8271-4ef1-906f-fa9c0d15ba82'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:51 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:21:51 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:51 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.327s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Deleted volume successfully. Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-54ff9180-149f-4ef5-951c-95a50d2b9998 tempest-AbsoluteLimitsTests-1733790390 None] Lock "cinder-8a1fbb3b-34bb-4f34-a882-3db440e828e8-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:51 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.382s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Deleted volume successfully. Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Acquiring lock "cinder-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad28f614-8bef-4957-94e3-3c68ba3358ea tempest-VolumesSnapshotListTestJSON-1926735139 None] Lock "cinder-55da8441-3dfb-4867-8dde-9d298a313eff-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Lock "cinder-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Acquiring lock "cinder-quobyte-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Lock "cinder-quobyte-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fcad2b-3ed7-452d-8e0b-a1e8977d13ad]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:51 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e Nov 05 22:21:51 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:52 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e" returned: 0 in 0.616s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:52 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e Nov 05 22:21:52 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:52 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e" returned: 0 in 0.470s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Lock "cinder-quobyte-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e" released by "delete_volume" :: held 1.154s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Created reservations ['6de4f7e2-0be6-472a-a219-84721bf741d5', 'ec47a1fc-a7de-43e7-a70c-bd6caec0e842', '4092f4d6-dd78-4269-8397-042724e6e8b4', 'd3cdcf9b-9665-4ddc-8d84-f2fb2bf21ba9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:52 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:21:52 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:53 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.301s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:53 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Deleted volume successfully. Nov 05 22:21:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4ef8ecaf-7d72-4b84-94c5-ee40aea187fd tempest-VolumesExtendTest-199926380 None] Lock "cinder-02b3d3ca-46a6-46c6-96fa-c4e724cb9f5e-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Flow 'volume_create_manager' (61871c14-3570-4c0d-b3dd-9d7df2b1d557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e86d888-9726-49c9-80f3-8a3d0d40b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e86d888-9726-49c9-80f3-8a3d0d40b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-680380683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d9c63f-5757-4f79-abbd-a1a4182782ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e58e475ffff4ea6ac2ae198061790ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:54Z,use_quota=True,user_id='f26eb9b88ce049f5bbe6cdf82de95c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661c94e8-9e1d-4164-b411-862b85810393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661c94e8-9e1d-4164-b411-862b85810393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7856ad-e90c-4b81-8184-63a1608387f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7856ad-e90c-4b81-8184-63a1608387f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d9c63f-5757-4f79-abbd-a1a4182782ea', 'volume_name': 'volume-79d9c63f-5757-4f79-abbd-a1a4182782ea', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23ec2a4-f887-496b-a4e7-09b5077f6236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23ec2a4-f887-496b-a4e7-09b5077f6236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b14eb3-65d4-428f-bdd3-32a62c7aab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Volume 79d9c63f-5757-4f79-abbd-a1a4182782ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d9c63f-5757-4f79-abbd-a1a4182782ea', 'volume_size': 1} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-680380683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d9c63f-5757-4f79-abbd-a1a4182782ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e58e475ffff4ea6ac2ae198061790ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:54Z,use_quota=True,user_id='f26eb9b88ce049f5bbe6cdf82de95c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Creating volume 79d9c63f-5757-4f79-abbd-a1a4182782ea {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:54 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:21:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:54 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea 1073741824 Nov 05 22:21:54 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:55 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea 1073741824" returned: 0 in 0.632s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:55 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea Nov 05 22:21:55 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:55 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b14eb3-65d4-428f-bdd3-32a62c7aab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d9c63f-5757-4f79-abbd-a1a4182782ea', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca58c64-8b3f-4e2b-812d-2545c588714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Volume volume-79d9c63f-5757-4f79-abbd-a1a4182782ea (79d9c63f-5757-4f79-abbd-a1a4182782ea): created successfully Nov 05 22:21:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca58c64-8b3f-4e2b-812d-2545c588714e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Flow 'volume_create_manager' (61871c14-3570-4c0d-b3dd-9d7df2b1d557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6db4ac80-c859-4ed3-89c7-5762a227580c tempest-VolumesExtendTest-199926380 None] Created volume successfully. Nov 05 22:21:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Creating offline snapshot a0e5ba8c-c2d2-491a-ac95-2d3802c84933 of volume 79d9c63f-5757-4f79-abbd-a1a4182782ea {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:21:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd100076-d0f7-4a83-bc61-74c60f2fb7b6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:57 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea Nov 05 22:21:57 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:57 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea" returned: 0 in 0.624s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:57 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 1G Nov 05 22:21:57 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:21:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:57 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:21:57 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:58 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.413s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:58 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:21:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:21:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:21:58 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 1G" returned: 0 in 0.598s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d9c63f-5757-4f79-abbd-a1a4182782ea -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:58 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d9c63f-5757-4f79-abbd-a1a4182782ea -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 Nov 05 22:21:58 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:58 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d9c63f-5757-4f79-abbd-a1a4182782ea -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933" returned: 0 in 0.477s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:58 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 is being set with open permissions: ugo+rw Nov 05 22:21:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:58 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 Nov 05 22:21:58 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:59 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933" returned: 0 in 0.446s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:59 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.info Nov 05 22:21:59 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Flow 'volume_create_manager' (789c91ac-4aa4-4084-8c29-90d577a8bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bc6e30-a383-49f7-a016-24a60462e182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bc6e30-a383-49f7-a016-24a60462e182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1089019968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab828137-1052-4c22-a946-41a308f958d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f6a80c86f74e2a8d0cd24756d1d99e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:59Z,use_quota=True,user_id='7f7a0c8f1f0844309e04b40e941ff212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e398b6-624b-4d24-8d1b-8d1a02d3803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e398b6-624b-4d24-8d1b-8d1a02d3803e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bba402-28ed-4411-9a67-1d52ee6b1eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bba402-28ed-4411-9a67-1d52ee6b1eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab828137-1052-4c22-a946-41a308f958d0', 'volume_name': 'volume-ab828137-1052-4c22-a946-41a308f958d0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab91f9a-ff68-4d2f-8caa-0b7e53b2081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab91f9a-ff68-4d2f-8caa-0b7e53b2081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50edec6c-6d6b-4521-b364-208b87592e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Volume ab828137-1052-4c22-a946-41a308f958d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab828137-1052-4c22-a946-41a308f958d0', 'volume_size': 1} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:59 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.info" returned: 0 in 0.344s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:59 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.info is being set with open permissions: ugo+rw Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:59 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.info Nov 05 22:21:59 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:59 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.info" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.394s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1089019968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab828137-1052-4c22-a946-41a308f958d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f6a80c86f74e2a8d0cd24756d1d99e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:59Z,use_quota=True,user_id='7f7a0c8f1f0844309e04b40e941ff212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Creating volume ab828137-1052-4c22-a946-41a308f958d0 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:59 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:21:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:59 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0 1073741824 Nov 05 22:21:59 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9d8bb4b5-c830-4771-9821-5724e8c15126 tempest-VolumesExtendTest-199926380 None] Create snapshot completed successfully Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-46b41f71-ae74-43b2-8e64-039b3b259179 tempest-VolumesExtendTest-199926380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:00 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0 1073741824" returned: 0 in 0.670s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:00 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0 Nov 05 22:22:00 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:00 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0" returned: 0 in 0.271s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-46b41f71-ae74-43b2-8e64-039b3b259179 tempest-VolumesExtendTest-199926380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.473s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da616b18-2f59-4e01-a08c-49cf17845569]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-46b41f71-ae74-43b2-8e64-039b3b259179 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50edec6c-6d6b-4521-b364-208b87592e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab828137-1052-4c22-a946-41a308f958d0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363af419-5ff7-438a-be73-3bb7f5c2bc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:00 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Volume volume-ab828137-1052-4c22-a946-41a308f958d0 (ab828137-1052-4c22-a946-41a308f958d0): created successfully Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363af419-5ff7-438a-be73-3bb7f5c2bc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Flow 'volume_create_manager' (789c91ac-4aa4-4084-8c29-90d577a8bffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2dc7a5c8-ab15-4851-8a03-73902a7d93c7 tempest-VolumesMetadataTest-1417539054 None] Created volume successfully. Nov 05 22:22:00 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea Nov 05 22:22:00 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:01 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-46b41f71-ae74-43b2-8e64-039b3b259179 tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea" returned: 0 in 0.432s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-46b41f71-ae74-43b2-8e64-039b3b259179 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 2G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-46b41f71-ae74-43b2-8e64-039b3b259179 tempest-VolumesExtendTest-199926380 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 2G" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-46b41f71-ae74-43b2-8e64-039b3b259179 tempest-VolumesExtendTest-199926380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.728s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-46b41f71-ae74-43b2-8e64-039b3b259179 tempest-VolumesExtendTest-199926380 None] Extend volume completed successfully. Nov 05 22:22:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Acquiring lock "cinder-ab828137-1052-4c22-a946-41a308f958d0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Lock "cinder-ab828137-1052-4c22-a946-41a308f958d0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Acquiring lock "cinder-quobyte-ab828137-1052-4c22-a946-41a308f958d0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Lock "cinder-quobyte-ab828137-1052-4c22-a946-41a308f958d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8902875-2828-44b2-86df-5411eece5e6a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Acquiring lock "cinder-a0e5ba8c-c2d2-491a-ac95-2d3802c84933-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:02 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0 Nov 05 22:22:02 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Lock "cinder-a0e5ba8c-c2d2-491a-ac95-2d3802c84933-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Acquiring lock "cinder-quobyte-79d9c63f-5757-4f79-abbd-a1a4182782ea" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Lock "cinder-quobyte-79d9c63f-5757-4f79-abbd-a1a4182782ea" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Acquiring lock "cinder-quobyte-a0e5ba8c-c2d2-491a-ac95-2d3802c84933" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Lock "cinder-quobyte-a0e5ba8c-c2d2-491a-ac95-2d3802c84933" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Deleting offline snapshot a0e5ba8c-c2d2-491a-ac95-2d3802c84933 of volume 79d9c63f-5757-4f79-abbd-a1a4182782ea {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] snapshot_file for this snap is: volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ded66f5-132c-4cb3-bfee-2e06fe8b6fc2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:03 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 Nov 05 22:22:03 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:03 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0" returned: 0 in 0.650s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:03 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0 Nov 05 22:22:03 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:03 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933" returned: 0 in 0.783s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79d9c63f-5757-4f79-abbd-a1a4182782ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac50c17c-e0b5-4061-ad3b-a76230878e51]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:03 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ab828137-1052-4c22-a946-41a308f958d0" returned: 0 in 0.596s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Lock "cinder-quobyte-ab828137-1052-4c22-a946-41a308f958d0" released by "delete_volume" :: held 1.373s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Created reservations ['7c27f794-3572-464f-8110-7b14b9e87ecb', 'f0e490e3-4815-41ad-8933-21b0ffd7b498', 'b55e0e6b-d418-4c55-9d43-0b8ce527003f', '8163b8c1-dc23-4a0b-b1bb-60bd3c7da4e1'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:04 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea Nov 05 22:22:04 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:04 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:22:04 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:04 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea" returned: 0 in 0.503s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:04 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 Nov 05 22:22:04 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:04 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.379s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Deleted volume successfully. Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-04e6a6a1-14bf-4476-9907-23fc05990933 tempest-VolumesMetadataTest-1417539054 None] Lock "cinder-ab828137-1052-4c22-a946-41a308f958d0-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:04 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933" returned: 0 in 0.472s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:04 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933 Nov 05 22:22:04 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:05 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea.a0e5ba8c-c2d2-491a-ac95-2d3802c84933" returned: 0 in 0.430s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Lock "cinder-quobyte-a0e5ba8c-c2d2-491a-ac95-2d3802c84933" released by "_delete_snapshot" :: held 2.395s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Lock "cinder-quobyte-79d9c63f-5757-4f79-abbd-a1a4182782ea" released by "delete_snapshot" :: held 2.445s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:05 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Created reservations ['945e2a37-fd3e-4a3d-8299-55f4fcab2b6b', 'ca063f1c-dd44-4832-964d-2bbe6c3573d2', 'f236404c-97a9-4576-8924-aaff2fff56e4', '20be301b-6c88-436c-85a4-3b792f1dab00'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Delete snapshot completed successfully. Nov 05 22:22:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d87dca91-83fd-424b-b243-ad5bbc916c94 tempest-VolumesExtendTest-199926380 None] Lock "cinder-a0e5ba8c-c2d2-491a-ac95-2d3802c84933-delete_snapshot" released by "delete_snapshot" :: held 2.704s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Acquiring lock "cinder-79d9c63f-5757-4f79-abbd-a1a4182782ea-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Lock "cinder-79d9c63f-5757-4f79-abbd-a1a4182782ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Acquiring lock "cinder-quobyte-79d9c63f-5757-4f79-abbd-a1a4182782ea" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Lock "cinder-quobyte-79d9c63f-5757-4f79-abbd-a1a4182782ea" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8474d51-8ca4-4707-9c14-fca716136a3f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:06 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea Nov 05 22:22:06 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:07 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea" returned: 0 in 0.636s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:07 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea Nov 05 22:22:07 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:07 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-79d9c63f-5757-4f79-abbd-a1a4182782ea" returned: 0 in 0.458s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Lock "cinder-quobyte-79d9c63f-5757-4f79-abbd-a1a4182782ea" released by "delete_volume" :: held 1.201s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Created reservations ['88d03159-e0ff-4d04-aee9-9f79d4020c53', 'c127948f-ed2b-4d61-931f-176c0c55b66d', '1e197560-7013-43f3-8a72-30e9c2b7f268', 'f2f189ad-7867-46a8-b9d7-5d37a39113cb'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:07 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:22:07 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:08 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.599s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:08 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Deleted volume successfully. Nov 05 22:22:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9040eb66-cf71-4ae1-ad54-4447c4411b7b tempest-VolumesExtendTest-199926380 None] Lock "cinder-79d9c63f-5757-4f79-abbd-a1a4182782ea-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:17 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=93,cinder:INSERT=34,cinder:UPDATE=111,cinder:DELETE=9 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:22:18 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=93,cinder:UPDATE=112,cinder:INSERT=35,cinder:DELETE=8 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Flow 'volume_create_manager' (5e3c34a1-154f-4546-9913-e2b9f3b8cf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9b96ba-d080-41ea-bc16-983fc3821595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9b96ba-d080-41ea-bc16-983fc3821595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1609161787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b29b4874d4faabaf843e8a72b0cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:24Z,use_quota=True,user_id='7e15638493e448ada47bfe2059a4a0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b362e938-71d5-48fc-aca3-5597246ceb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b362e938-71d5-48fc-aca3-5597246ceb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ae81ec-9408-46eb-8b89-1f7d6dc84c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ae81ec-9408-46eb-8b89-1f7d6dc84c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24', 'volume_name': 'volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1233d6c8-3bc2-40e5-8e64-6f88e017ec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1233d6c8-3bc2-40e5-8e64-6f88e017ec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b16e7f-dd8e-4365-a2a0-eb607bb915a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:24 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Volume 61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24', 'volume_size': 1} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1609161787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190b29b4874d4faabaf843e8a72b0cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:24Z,use_quota=True,user_id='7e15638493e448ada47bfe2059a4a0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Creating volume 61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:24 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:24 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 1073741824 Nov 05 22:22:24 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:24 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 1073741824" returned: 0 in 0.596s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:24 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 Nov 05 22:22:24 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:25 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b16e7f-dd8e-4365-a2a0-eb607bb915a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1705269c-85f4-48e3-9982-24fd18ec189e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Volume volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 (61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24): created successfully Nov 05 22:22:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1705269c-85f4-48e3-9982-24fd18ec189e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Flow 'volume_create_manager' (5e3c34a1-154f-4546-9913-e2b9f3b8cf57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3003b793-fb16-40d9-967e-c0738af7cedc tempest-VolumesNegativeTest-543666524 None] Created volume successfully. Nov 05 22:22:31 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Flow 'volume_create_manager' (2a95628b-60f8-405f-9120-2f610c2b4530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c103c31e-68a9-4561-a48d-c5b21997feea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c103c31e-68a9-4561-a48d-c5b21997feea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-509518729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a3f6ba-ec09-4e15-9157-a47fa3783714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93accf273e024ad2810cef32abc06f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:32Z,use_quota=True,user_id='350628db5309456486ee8247554fe89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851e6dcc-1d91-4258-b674-d98cbc38b864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851e6dcc-1d91-4258-b674-d98cbc38b864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b363610-7232-4ee8-92fb-3ef30883c942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b363610-7232-4ee8-92fb-3ef30883c942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66a3f6ba-ec09-4e15-9157-a47fa3783714', 'volume_name': 'volume-66a3f6ba-ec09-4e15-9157-a47fa3783714', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf3481c-c9bc-438d-9ed3-41fc864a7374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf3481c-c9bc-438d-9ed3-41fc864a7374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51af7909-8720-4123-8f15-f488260accfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:32 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Volume 66a3f6ba-ec09-4e15-9157-a47fa3783714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66a3f6ba-ec09-4e15-9157-a47fa3783714', 'volume_size': 1} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-509518729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a3f6ba-ec09-4e15-9157-a47fa3783714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93accf273e024ad2810cef32abc06f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:32Z,use_quota=True,user_id='350628db5309456486ee8247554fe89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Creating volume 66a3f6ba-ec09-4e15-9157-a47fa3783714 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:32 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:32 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714 1073741824 Nov 05 22:22:32 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:32 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714 1073741824" returned: 0 in 0.544s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:32 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714 Nov 05 22:22:32 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:32 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714" returned: 0 in 0.285s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51af7909-8720-4123-8f15-f488260accfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a3f6ba-ec09-4e15-9157-a47fa3783714', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce1ec24-8d55-4923-bac6-dadbc100d692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:32 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Volume volume-66a3f6ba-ec09-4e15-9157-a47fa3783714 (66a3f6ba-ec09-4e15-9157-a47fa3783714): created successfully Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce1ec24-8d55-4923-bac6-dadbc100d692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Flow 'volume_create_manager' (2a95628b-60f8-405f-9120-2f610c2b4530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ff433225-49b4-4fcd-a622-7560bb3c52f0 tempest-AttachVolumeTestJSON-203979272 None] Created volume successfully. Nov 05 22:22:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-2e6c037c-4fa6-4041-902f-c56b2f624279 req-557bd793-8508-4c2b-a6cf-0cdea4fe4880 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-2e6c037c-4fa6-4041-902f-c56b2f624279 req-557bd793-8508-4c2b-a6cf-0cdea4fe4880 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-2e6c037c-4fa6-4041-902f-c56b2f624279 req-557bd793-8508-4c2b-a6cf-0cdea4fe4880 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-2e6c037c-4fa6-4041-902f-c56b2f624279 req-557bd793-8508-4c2b-a6cf-0cdea4fe4880 tempest-AttachVolumeTestJSON-203979272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-66a3f6ba-ec09-4e15-9157-a47fa3783714', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '475948e3-a65b-4243-81c4-9f5286ae3671', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:22:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-2e6c037c-4fa6-4041-902f-c56b2f624279 req-557bd793-8508-4c2b-a6cf-0cdea4fe4880 tempest-AttachVolumeTestJSON-203979272 None] attachment_update completed successfully. Nov 05 22:22:36 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Flow 'volume_create_manager' (4f2c760f-6f4d-4500-8cbf-e94cb03e9ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2943342e-1c6d-4ca8-ad87-69ecd3010c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2943342e-1c6d-4ca8-ad87-69ecd3010c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-832140181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5a28f8-ab61-4489-bb20-181defd1307b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4ada4441714ea38cffd4032d9bf21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:36Z,use_quota=True,user_id='3ba93161f4f94aed8b9ff3495548c217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e272de-5b84-48b3-874c-6d616ae7ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e272de-5b84-48b3-874c-6d616ae7ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b76db7-946f-4a20-be7b-545f62f0b8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:36 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:22:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b76db7-946f-4a20-be7b-545f62f0b8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4f5a28f8-ab61-4489-bb20-181defd1307b', 'volume_name': 'volume-4f5a28f8-ab61-4489-bb20-181defd1307b', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dff52c3-4f8b-4804-9122-79adb75fbf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dff52c3-4f8b-4804-9122-79adb75fbf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6a1a27-552c-44a8-9e14-3b380b8e6d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Volume 4f5a28f8-ab61-4489-bb20-181defd1307b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4f5a28f8-ab61-4489-bb20-181defd1307b', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 22:22:37 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Trying to clone 4f5a28f8-ab61-4489-bb20-181defd1307b from image a030b230-32ee-42bd-ba4c-7115346087a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:22:38 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:22:38 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Image download 20.69 MB at 20.69 MB/s Nov 05 22:22:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de75f49-1ea7-4a40-a8c0-8e2545ddfa90]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:38 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD Nov 05 22:22:38 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:38 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:38 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Temporary image a030b230-32ee-42bd-ba4c-7115346087a9 is fetched for user 3ba93161f4f94aed8b9ff3495548c217. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:22:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[26141520-a867-40ec-94c0-0135c2140aef]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:38 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD Nov 05 22:22:38 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:39 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD" returned: 0 in 0.595s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-832140181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5a28f8-ab61-4489-bb20-181defd1307b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4ada4441714ea38cffd4032d9bf21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:36Z,use_quota=True,user_id='3ba93161f4f94aed8b9ff3495548c217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Creating volume 4f5a28f8-ab61-4489-bb20-181defd1307b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:22:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:39 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b 1073741824 Nov 05 22:22:39 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Flow 'volume_create_manager' (7d453a9c-6924-421b-aaff-9571967d5538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6843f9d-ad37-4bdd-8276-6dc9fcf665bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6843f9d-ad37-4bdd-8276-6dc9fcf665bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1845351096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd9848f-98c5-49df-bf4b-073968ca7c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93accf273e024ad2810cef32abc06f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:40Z,use_quota=True,user_id='350628db5309456486ee8247554fe89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66034887-bb87-4519-8060-2feaa40c65bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66034887-bb87-4519-8060-2feaa40c65bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b049353-3d7e-4e3a-bf24-083ad097b1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b049353-3d7e-4e3a-bf24-083ad097b1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd9848f-98c5-49df-bf4b-073968ca7c85', 'volume_name': 'volume-3cd9848f-98c5-49df-bf4b-073968ca7c85', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb40b6c-e05f-43ae-ab3f-ee954589bb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb40b6c-e05f-43ae-ab3f-ee954589bb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0c4b39-3194-4b81-9dc0-f847fe616768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Volume 3cd9848f-98c5-49df-bf4b-073968ca7c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd9848f-98c5-49df-bf4b-073968ca7c85', 'volume_size': 1} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:40 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b 1073741824" returned: 0 in 1.107s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:40 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b Nov 05 22:22:40 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:40 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b" returned: 0 in 0.319s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1845351096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd9848f-98c5-49df-bf4b-073968ca7c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93accf273e024ad2810cef32abc06f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:40Z,use_quota=True,user_id='350628db5309456486ee8247554fe89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Creating volume 3cd9848f-98c5-49df-bf4b-073968ca7c85 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:40 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Attempting download of a030b230-32ee-42bd-ba4c-7115346087a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}])) to volume 4f5a28f8-ab61-4489-bb20-181defd1307b. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:22:40 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85 1073741824 Nov 05 22:22:40 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84d9087-3ebb-479d-b332-d4b3574af114]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_sjx6vp20 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:41 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_sjx6vp20 Nov 05 22:22:41 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:41 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85 1073741824" returned: 0 in 0.674s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:41 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_sjx6vp20" returned: 0 in 0.560s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_sjx6vp20 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:41 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85 Nov 05 22:22:41 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:41 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_sjx6vp20 Nov 05 22:22:41 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:41 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85" returned: 0 in 0.347s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0c4b39-3194-4b81-9dc0-f847fe616768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd9848f-98c5-49df-bf4b-073968ca7c85', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53f7894-c862-4d08-a39c-003622f6a1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:41 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_sjx6vp20" returned: 1 in 0.424s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_sjx6vp20' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d3b093-3e83-4f4c-8eed-1a4ba26d10f8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Volume volume-3cd9848f-98c5-49df-bf4b-073968ca7c85 (3cd9848f-98c5-49df-bf4b-073968ca7c85): created successfully Nov 05 22:22:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53f7894-c862-4d08-a39c-003622f6a1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Flow 'volume_create_manager' (7d453a9c-6924-421b-aaff-9571967d5538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-23213a40-8344-4612-a33a-92f0acb81991 tempest-AttachVolumeTestJSON-203979272 None] Created volume successfully. Nov 05 22:22:42 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD Nov 05 22:22:42 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:42 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:42 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] a030b230-32ee-42bd-ba4c-7115346087a9 was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:22:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:42 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b Nov 05 22:22:42 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-0788b361-2c1a-463f-8db8-63fe512bf63c req-0f39f51c-fe0a-443f-bcee-046a5ec21cbe tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-0788b361-2c1a-463f-8db8-63fe512bf63c req-0f39f51c-fe0a-443f-bcee-046a5ec21cbe tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-0788b361-2c1a-463f-8db8-63fe512bf63c req-0f39f51c-fe0a-443f-bcee-046a5ec21cbe tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-0788b361-2c1a-463f-8db8-63fe512bf63c req-0f39f51c-fe0a-443f-bcee-046a5ec21cbe tempest-AttachVolumeTestJSON-203979272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-3cd9848f-98c5-49df-bf4b-073968ca7c85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b5efd48-81c1-49ab-bf02-461df6b3d1ca', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:22:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-0788b361-2c1a-463f-8db8-63fe512bf63c req-0f39f51c-fe0a-443f-bcee-046a5ec21cbe tempest-AttachVolumeTestJSON-203979272 None] attachment_update completed successfully. Nov 05 22:22:45 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b" returned: 0 in 2.923s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:45 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_llp5i5u1devstack@QuobyteHD, size 112.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:22:45 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Converted 112.00 MB image at 38.30 MB/s Nov 05 22:22:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:45 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b 1G Nov 05 22:22:45 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:45 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b 1G" returned: 0 in 0.503s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:45 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Downloaded image a030b230-32ee-42bd-ba4c-7115346087a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}])) to volume 4f5a28f8-ab61-4489-bb20-181defd1307b successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:22:45 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Temporary image a030b230-32ee-42bd-ba4c-7115346087a9 for user 3ba93161f4f94aed8b9ff3495548c217 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:22:45 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Marking volume 4f5a28f8-ab61-4489-bb20-181defd1307b as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:22:45 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Copying metadata from image a030b230-32ee-42bd-ba4c-7115346087a9 to 4f5a28f8-ab61-4489-bb20-181defd1307b. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:22:45 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Creating volume glance metadata for volume 4f5a28f8-ab61-4489-bb20-181defd1307b backed by image a030b230-32ee-42bd-ba4c-7115346087a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:22:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6a1a27-552c-44a8-9e14-3b380b8e6d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5a28f8-ab61-4489-bb20-181defd1307b', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f157fb-358b-4597-9afa-ce21ced944e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Volume volume-4f5a28f8-ab61-4489-bb20-181defd1307b (4f5a28f8-ab61-4489-bb20-181defd1307b): created successfully Nov 05 22:22:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f157fb-358b-4597-9afa-ce21ced944e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Flow 'volume_create_manager' (4f2c760f-6f4d-4500-8cbf-e94cb03e9ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e0c14e01-038e-475b-9086-7a8ddc8bcd8d tempest-TestShelveInstance-2097281360 None] Created volume successfully. Nov 05 22:22:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-c7bb231c-58b6-4e47-a0d3-adb614ca3940 req-3d8b20e4-d7bb-4822-88d4-ec7e69e052d9 tempest-AttachVolumeTestJSON-203979272 None] Terminate volume connection completed successfully. Nov 05 22:22:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-c7bb231c-58b6-4e47-a0d3-adb614ca3940 req-3d8b20e4-d7bb-4822-88d4-ec7e69e052d9 tempest-AttachVolumeTestJSON-203979272 None] Deleting attachment 475948e3-a65b-4243-81c4-9f5286ae3671. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:22:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-7cddc0cc-92f8-43e8-83e9-a53ee437314b req-bbc420bf-826b-433f-b97d-b0e8f54f78e2 tempest-AttachVolumeTestJSON-203979272 None] Terminate volume connection completed successfully. Nov 05 22:22:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7cddc0cc-92f8-43e8-83e9-a53ee437314b req-bbc420bf-826b-433f-b97d-b0e8f54f78e2 tempest-AttachVolumeTestJSON-203979272 None] Deleting attachment 3b5efd48-81c1-49ab-bf02-461df6b3d1ca. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:22:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3611adad-8bfc-443d-b84e-94cd3036edf3 req-f98c11b8-0fc2-43ae-b4eb-41f5e14afefc tempest-TestShelveInstance-2097281360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3611adad-8bfc-443d-b84e-94cd3036edf3 req-f98c11b8-0fc2-43ae-b4eb-41f5e14afefc tempest-TestShelveInstance-2097281360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-3611adad-8bfc-443d-b84e-94cd3036edf3 req-f98c11b8-0fc2-43ae-b4eb-41f5e14afefc tempest-TestShelveInstance-2097281360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-3611adad-8bfc-443d-b84e-94cd3036edf3 req-f98c11b8-0fc2-43ae-b4eb-41f5e14afefc tempest-TestShelveInstance-2097281360 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-4f5a28f8-ab61-4489-bb20-181defd1307b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9896cc17-f204-44d5-b293-af6a8f752e73', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:22:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-3611adad-8bfc-443d-b84e-94cd3036edf3 req-f98c11b8-0fc2-43ae-b4eb-41f5e14afefc tempest-TestShelveInstance-2097281360 None] attachment_update completed successfully. Nov 05 22:22:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Acquiring lock "cinder-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Lock "cinder-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Acquiring lock "cinder-quobyte-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Lock "cinder-quobyte-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d05c1b-a43c-4eaa-8225-e4fcc1043e4f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:52 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 Nov 05 22:22:52 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:53 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24" returned: 0 in 0.545s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:53 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24 Nov 05 22:22:53 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:53 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Lock "cinder-quobyte-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24" released by "delete_volume" :: held 1.083s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Created reservations ['957b7364-b9fd-4cfb-88f0-f7ee9e5cef60', 'eec6c6ed-942e-4463-bfd4-5f8a249bcb20', 'c52e84f3-1bde-472e-b98a-9a0ebf6d9596', '5b6c3141-70b2-4ce0-bf3a-e2157f36d27e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:53 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:22:53 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.485s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:54 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:54 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Deleted volume successfully. Nov 05 22:22:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0128722f-9db3-45b9-a3a6-a7350d6628a0 tempest-VolumesNegativeTest-543666524 None] Lock "cinder-61d6e9a3-638c-4c87-a60a-a2b7f8b4cb24-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "cinder-3cd9848f-98c5-49df-bf4b-073968ca7c85-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-3cd9848f-98c5-49df-bf4b-073968ca7c85-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "cinder-quobyte-3cd9848f-98c5-49df-bf4b-073968ca7c85" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-quobyte-3cd9848f-98c5-49df-bf4b-073968ca7c85" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b285d9-7500-48f3-a0b2-e8cd66834bce]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:57 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85 Nov 05 22:22:57 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:57 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85" returned: 0 in 0.566s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:57 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:22:57 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:57 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85 Nov 05 22:22:57 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:58 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3cd9848f-98c5-49df-bf4b-073968ca7c85" returned: 0 in 0.490s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-quobyte-3cd9848f-98c5-49df-bf4b-073968ca7c85" released by "delete_volume" :: held 1.214s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:58 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.715s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Created reservations ['bbd379e0-a3bc-4f4f-9382-5522857b55c9', 'd1d61b59-d3d6-4e28-8a6e-ee3bd0e40b99', '144cf754-4047-472b-824f-c151df47ac69', '5cb24dd7-adb2-4432-b263-69bfdc195329'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:58 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:22:58 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:59 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.815s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:59 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Deleted volume successfully. Nov 05 22:22:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-012d0ee5-b9ff-4285-85bf-21316708b915 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-3cd9848f-98c5-49df-bf4b-073968ca7c85-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "cinder-66a3f6ba-ec09-4e15-9157-a47fa3783714-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-66a3f6ba-ec09-4e15-9157-a47fa3783714-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "cinder-quobyte-66a3f6ba-ec09-4e15-9157-a47fa3783714" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-quobyte-66a3f6ba-ec09-4e15-9157-a47fa3783714" acquired by "delete_volume" :: waited 0.053s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e4ae80-73ab-4f4e-a4d3-060505c58c4c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:00 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714 Nov 05 22:23:00 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:01 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714" returned: 0 in 1.431s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:01 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714 Nov 05 22:23:01 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:02 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-66a3f6ba-ec09-4e15-9157-a47fa3783714" returned: 0 in 0.716s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-quobyte-66a3f6ba-ec09-4e15-9157-a47fa3783714" released by "delete_volume" :: held 2.292s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:02 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Created reservations ['6da4f93c-4f42-4407-8dca-ca5df816b924', 'bc3b93e7-f1ed-43e8-9757-110f9e5da6c7', 'aa5b8067-ea54-4668-b82c-ab3b8ec4fc49', 'ec219534-656a-4449-8123-3c196eb3f987'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:02 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:23:02 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:03 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.517s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:03 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Deleted volume successfully. Nov 05 22:23:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2dd34300-a66d-43b8-9116-223cbc1c1a38 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-66a3f6ba-ec09-4e15-9157-a47fa3783714-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "cinder-50d62c0c-1916-4276-a5cb-d544be6a57b0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-50d62c0c-1916-4276-a5cb-d544be6a57b0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "cinder-quobyte-50d62c0c-1916-4276-a5cb-d544be6a57b0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-quobyte-50d62c0c-1916-4276-a5cb-d544be6a57b0" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[781bb162-2ed0-44e9-bd25-8ca22e17ac74]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:03 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0 Nov 05 22:23:04 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:04 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0" returned: 0 in 0.916s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:04 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0 Nov 05 22:23:04 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:05 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-50d62c0c-1916-4276-a5cb-d544be6a57b0" returned: 0 in 0.419s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-quobyte-50d62c0c-1916-4276-a5cb-d544be6a57b0" released by "delete_volume" :: held 1.422s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Created reservations ['0a3cffd9-cc23-446d-b850-582ef6acf744', '3fc7ec68-196d-4acc-a763-e602987b7214', '8e0875c1-67f4-4ef5-894c-96248dedae55', '4aa21b96-cc4d-4369-b2e2-f697d4851aeb'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:05 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:23:05 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:05 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.475s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:05 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Deleted volume successfully. Nov 05 22:23:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-34d78388-8f56-4505-8935-a3c293c97f62 tempest-AttachVolumeTestJSON-203979272 None] Lock "cinder-50d62c0c-1916-4276-a5cb-d544be6a57b0-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:15 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=53,cinder:UPDATE=53,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:23:15 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=48,cinder:SELECT=62,cinder:DELETE=5,cinder:INSERT=13 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Flow 'volume_create_manager' (f12024c7-9840-4af2-8006-fca689071994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8db320-26a0-4453-849f-ddc7bb162f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8db320-26a0-4453-849f-ddc7bb162f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1307790635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a13ba6c9b8460bafdbae3d3d036b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:20Z,use_quota=True,user_id='fde9952e637b466185abb7d3a3f8850d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee32b59a-4614-4a1f-a46b-a47e5aaec927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee32b59a-4614-4a1f-a46b-a47e5aaec927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ebf2e5-c87f-4005-8bc1-32eb95a88998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ebf2e5-c87f-4005-8bc1-32eb95a88998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf', 'volume_name': 'volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a32e58-7cac-4021-ba85-a1f3dc34fdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a32e58-7cac-4021-ba85-a1f3dc34fdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa55d5c-6602-40f9-9e1b-fd7017b4d5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume 87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf', 'volume_size': 1} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1307790635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a13ba6c9b8460bafdbae3d3d036b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:20Z,use_quota=True,user_id='fde9952e637b466185abb7d3a3f8850d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Creating volume 87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:19 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:23:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:19 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf 1073741824 Nov 05 22:23:19 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:20 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf 1073741824" returned: 0 in 0.417s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:20 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf Nov 05 22:23:20 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:20 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" returned: 0 in 0.264s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa55d5c-6602-40f9-9e1b-fd7017b4d5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78999675-9bd6-4c9c-96ba-6e29c28f7de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf (87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf): created successfully Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78999675-9bd6-4c9c-96ba-6e29c28f7de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Flow 'volume_create_manager' (f12024c7-9840-4af2-8006-fca689071994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a9ec79ae-011f-4fca-816f-6244eabf8133 tempest-VolumesSnapshotTestJSON-2006061401 None] Created volume successfully. Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Creating offline snapshot 7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 of volume 87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:23:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b61b0bd-0397-40b1-a78e-2171317fe407]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:21 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf Nov 05 22:23:21 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:21 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" returned: 0 in 0.384s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:21 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 1G Nov 05 22:23:21 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:21 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 1G" returned: 0 in 0.486s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:21 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 Nov 05 22:23:21 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:22 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0" returned: 0 in 0.328s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:22 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 is being set with open permissions: ugo+rw Nov 05 22:23:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:22 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 Nov 05 22:23:22 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:22 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:22 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.info Nov 05 22:23:22 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:22 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.info" returned: 0 in 0.341s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:22 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.info is being set with open permissions: ugo+rw Nov 05 22:23:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:22 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.info Nov 05 22:23:22 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:23 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.info" returned: 0 in 0.339s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e7552fc9-27bc-468c-9717-3bcd3ad48575 tempest-VolumesSnapshotTestJSON-2006061401 None] Create snapshot completed successfully Nov 05 22:23:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Deleting offline snapshot 7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 of volume 87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:23:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] snapshot_file for this snap is: volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:23:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd3d5ac-838c-4506-b4ce-e24af6f0b79d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:24 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 Nov 05 22:23:24 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:25 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0" returned: 0 in 0.693s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:23:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[464e938a-8a18-4173-ab81-85ae4bd40d5d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:25 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf Nov 05 22:23:25 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:25 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:26 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 Nov 05 22:23:26 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:26 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Flow 'volume_create_manager' (fd510cac-5a25-471f-9993-8da7638394c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72e1f7a-09a9-4b78-9489-cd31d29629a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0" returned: 0 in 0.615s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72e1f7a-09a9-4b78-9489-cd31d29629a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-626931583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f83d0be-7cd4-4e13-802d-15920ac8336e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0de1d97fbd24b3198fc5ad09e085341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:26Z,use_quota=True,user_id='db3b1abffa5b43d08615f5b0bf412c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0dba675-bade-4496-862d-2c9483a523f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0dba675-bade-4496-862d-2c9483a523f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2535384-4ed2-4704-9255-64a0701b8892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2535384-4ed2-4704-9255-64a0701b8892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f83d0be-7cd4-4e13-802d-15920ac8336e', 'volume_name': 'volume-9f83d0be-7cd4-4e13-802d-15920ac8336e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3859a9ed-3176-47f8-983d-085597443dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:26 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0 Nov 05 22:23:26 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3859a9ed-3176-47f8-983d-085597443dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d365eba-cb7a-475b-bed8-d2720aa5a82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Volume 9f83d0be-7cd4-4e13-802d-15920ac8336e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f83d0be-7cd4-4e13-802d-15920ac8336e', 'volume_size': 1} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-626931583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f83d0be-7cd4-4e13-802d-15920ac8336e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0de1d97fbd24b3198fc5ad09e085341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:26Z,use_quota=True,user_id='db3b1abffa5b43d08615f5b0bf412c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Creating volume 9f83d0be-7cd4-4e13-802d-15920ac8336e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:26 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:23:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:26 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e 1073741824 Nov 05 22:23:26 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:27 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf.7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0" returned: 0 in 0.514s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0" released by "_delete_snapshot" :: held 2.501s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" released by "delete_snapshot" :: held 2.554s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Created reservations ['f6c0173b-fbee-4ba4-bca2-33c090f31e72', '045d2d66-2319-4eaf-babc-bedaf0604ce6', '44e9a685-9122-4edd-96da-5f025dfffea1', 'd1adc213-f220-43ca-b738-e37d473f19c3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Delete snapshot completed successfully. Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c93729e9-bf3b-43bf-9ac0-b5a9fe01cb06 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-7d603a80-6d2b-4d5d-a0f7-b1bd8c9728d0-delete_snapshot" released by "delete_snapshot" :: held 2.931s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:27 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e 1073741824" returned: 0 in 0.765s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:27 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e Nov 05 22:23:27 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:27 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d365eba-cb7a-475b-bed8-d2720aa5a82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f83d0be-7cd4-4e13-802d-15920ac8336e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e95ed6-4add-4017-bfa5-fa2f0fdf356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:27 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Volume volume-9f83d0be-7cd4-4e13-802d-15920ac8336e (9f83d0be-7cd4-4e13-802d-15920ac8336e): created successfully Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e95ed6-4add-4017-bfa5-fa2f0fdf356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Flow 'volume_create_manager' (fd510cac-5a25-471f-9993-8da7638394c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-90fac109-6ae7-4509-b99a-b79f6e6d123d tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Created volume successfully. Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Flow 'volume_create_manager' (416ffd4b-3d8d-4d54-8330-f62c28f5df95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f162d1d9-fed3-43fc-84ad-beddeb27500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f162d1d9-fed3-43fc-84ad-beddeb27500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1727370910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a13ba6c9b8460bafdbae3d3d036b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:29Z,use_quota=True,user_id='fde9952e637b466185abb7d3a3f8850d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8703f4-c758-4da7-8296-0196e8165e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8703f4-c758-4da7-8296-0196e8165e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8f912c-0335-4d8c-ac6b-85e7eca55c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8f912c-0335-4d8c-ac6b-85e7eca55c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923', 'volume_name': 'volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6048d6-6790-4256-9f5e-be5c85e0d58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6048d6-6790-4256-9f5e-be5c85e0d58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b631ed17-cf58-40ca-93ba-4ab99e1a1d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume 5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923', 'volume_size': 1} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1727370910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a13ba6c9b8460bafdbae3d3d036b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:29Z,use_quota=True,user_id='fde9952e637b466185abb7d3a3f8850d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Creating volume 5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:28 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:23:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:28 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 1073741824 Nov 05 22:23:28 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:29 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 1073741824" returned: 0 in 0.636s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:29 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 Nov 05 22:23:29 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:29 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" returned: 0 in 0.292s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b631ed17-cf58-40ca-93ba-4ab99e1a1d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd53dfc0-64b6-427e-9418-cddd0d19d256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:29 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 (5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923): created successfully Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd53dfc0-64b6-427e-9418-cddd0d19d256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Flow 'volume_create_manager' (416ffd4b-3d8d-4d54-8330-f62c28f5df95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1d1cd4f0-c943-47cb-a680-7a04d0db9b76 tempest-VolumesSnapshotTestJSON-2006061401 None] Created volume successfully. Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-0159f71e-085a-4996-ba7d-20f7abc4f98a req-ac40d8fa-e931-41e8-a4ad-3626dd82fef0 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-0159f71e-085a-4996-ba7d-20f7abc4f98a req-ac40d8fa-e931-41e8-a4ad-3626dd82fef0 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-0159f71e-085a-4996-ba7d-20f7abc4f98a req-ac40d8fa-e931-41e8-a4ad-3626dd82fef0 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-0159f71e-085a-4996-ba7d-20f7abc4f98a req-ac40d8fa-e931-41e8-a4ad-3626dd82fef0 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-9f83d0be-7cd4-4e13-802d-15920ac8336e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c22afe0f-53b1-42c7-bc72-c3298146583b', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:23:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-0159f71e-085a-4996-ba7d-20f7abc4f98a req-ac40d8fa-e931-41e8-a4ad-3626dd82fef0 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] attachment_update completed successfully. Nov 05 22:23:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Creating offline snapshot 3f63cc76-3d7f-4f78-8501-15163d177598 of volume 5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:23:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c73ab54-bea8-40ae-b4eb-409dc398b2ef]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:31 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 Nov 05 22:23:31 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-870093c6-64b6-4f13-91b0-3d5b8ccdf2d3 req-e23ca7e7-e280-497d-b9b6-a3ae78c08d70 tempest-TestShelveInstance-2097281360 None] Terminate volume connection completed successfully. Nov 05 22:23:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-870093c6-64b6-4f13-91b0-3d5b8ccdf2d3 req-e23ca7e7-e280-497d-b9b6-a3ae78c08d70 tempest-TestShelveInstance-2097281360 None] Deleting attachment 9896cc17-f204-44d5-b293-af6a8f752e73. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:23:31 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" returned: 0 in 0.473s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:31 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 1G Nov 05 22:23:31 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:32 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 1G" returned: 0 in 0.605s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:32 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 Nov 05 22:23:32 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:32 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598" returned: 0 in 0.425s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:32 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 is being set with open permissions: ugo+rw Nov 05 22:23:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:32 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 Nov 05 22:23:32 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:32 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:32 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.info Nov 05 22:23:32 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:33 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.info" returned: 0 in 0.473s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:33 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.info is being set with open permissions: ugo+rw Nov 05 22:23:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:33 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.info Nov 05 22:23:33 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-995dc14b-0ae0-4c40-9252-9a28dc61ea6f req-2d32f3dc-6e8e-419d-8261-ae6101585e8a tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Terminate volume connection completed successfully. Nov 05 22:23:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-995dc14b-0ae0-4c40-9252-9a28dc61ea6f req-2d32f3dc-6e8e-419d-8261-ae6101585e8a tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Deleting attachment c22afe0f-53b1-42c7-bc72-c3298146583b. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:23:33 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.info" returned: 0 in 0.325s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-28337152-d520-401a-bb80-1694a85f1bcf tempest-VolumesSnapshotTestJSON-2006061401 None] Create snapshot completed successfully Nov 05 22:23:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Acquiring lock "cinder-9f83d0be-7cd4-4e13-802d-15920ac8336e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "cinder-9f83d0be-7cd4-4e13-802d-15920ac8336e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Acquiring lock "cinder-quobyte-9f83d0be-7cd4-4e13-802d-15920ac8336e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "cinder-quobyte-9f83d0be-7cd4-4e13-802d-15920ac8336e" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[29083509-0095-41f5-98ea-df4ffa52733e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5cb54060-fce6-439f-83d6-6425548bfc1a req-7e28f0e8-0204-4ed9-9ba7-f550af34cb65 tempest-TestShelveInstance-2097281360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5cb54060-fce6-439f-83d6-6425548bfc1a req-7e28f0e8-0204-4ed9-9ba7-f550af34cb65 tempest-TestShelveInstance-2097281360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5cb54060-fce6-439f-83d6-6425548bfc1a req-7e28f0e8-0204-4ed9-9ba7-f550af34cb65 tempest-TestShelveInstance-2097281360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-5cb54060-fce6-439f-83d6-6425548bfc1a req-7e28f0e8-0204-4ed9-9ba7-f550af34cb65 tempest-TestShelveInstance-2097281360 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-4f5a28f8-ab61-4489-bb20-181defd1307b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7b5406c-7130-4037-ae2c-02d3bc24f2ec', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:23:34 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e Nov 05 22:23:34 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-5cb54060-fce6-439f-83d6-6425548bfc1a req-7e28f0e8-0204-4ed9-9ba7-f550af34cb65 tempest-TestShelveInstance-2097281360 None] attachment_update completed successfully. Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Flow 'volume_create_manager' (1df7dfc1-4b35-4194-9f86-d0ae66a0992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91910c49-c971-40ec-a11e-134b552ff6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91910c49-c971-40ec-a11e-134b552ff6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1086706617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0ef837-c13f-4eae-8e32-02d708f868b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a13ba6c9b8460bafdbae3d3d036b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3f63cc76-3d7f-4f78-8501-15163d177598,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:35Z,use_quota=True,user_id='fde9952e637b466185abb7d3a3f8850d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4bf0ab-4fa4-403c-ae16-828fe7f09f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4bf0ab-4fa4-403c-ae16-828fe7f09f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88671afd-ef8c-4a79-bd58-0aa4074d4fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88671afd-ef8c-4a79-bd58-0aa4074d4fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc0ef837-c13f-4eae-8e32-02d708f868b0', 'volume_name': 'volume-bc0ef837-c13f-4eae-8e32-02d708f868b0', 'volume_size': 2, 'snapshot_id': '3f63cc76-3d7f-4f78-8501-15163d177598'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad99d14-bf2d-4438-b5d6-82ca85d4e14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad99d14-bf2d-4438-b5d6-82ca85d4e14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753bec8d-f943-47b1-bc16-2e6272f0422f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume bc0ef837-c13f-4eae-8e32-02d708f868b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc0ef837-c13f-4eae-8e32-02d708f868b0', 'volume_size': 2, 'snapshot_id': '3f63cc76-3d7f-4f78-8501-15163d177598'} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-3f63cc76-3d7f-4f78-8501-15163d177598-bc0ef837-c13f-4eae-8e32-02d708f868b0" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-3f63cc76-3d7f-4f78-8501-15163d177598-bc0ef837-c13f-4eae-8e32-02d708f868b0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Creating volume bc0ef837-c13f-4eae-8e32-02d708f868b0 from snapshot 3f63cc76-3d7f-4f78-8501-15163d177598 {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-bc0ef837-c13f-4eae-8e32-02d708f868b0" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-bc0ef837-c13f-4eae-8e32-02d708f868b0" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] snapshot: 3f63cc76-3d7f-4f78-8501-15163d177598, volume: bc0ef837-c13f-4eae-8e32-02d708f868b0, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:35 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e" returned: 0 in 0.537s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[055203cf-d3f8-48c7-8ceb-7301ed3bcbc5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:35 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e Nov 05 22:23:35 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:35 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 Nov 05 22:23:35 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:35 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9f83d0be-7cd4-4e13-802d-15920ac8336e" returned: 0 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "cinder-quobyte-9f83d0be-7cd4-4e13-802d-15920ac8336e" released by "delete_volume" :: held 0.944s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Created reservations ['e358a214-4e86-4a49-8dfb-45f82eeee7cd', 'ed10e9eb-17c2-4309-8918-3952ed05a5d7', '37a699e6-15d2-452f-b2bf-ca99d9ef3570', '6f19ca0a-eccc-403e-a3a1-49e25d95abf4'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:35 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598" returned: 0 in 0.455s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fe702c-4d52-4bb6-a275-5c169804b191]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:35 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:23:35 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:35 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 Nov 05 22:23:35 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:36 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.293s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:36 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Deleted volume successfully. Nov 05 22:23:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-040fb6ea-f2e1-456a-a9aa-38773f371634 tempest-TestServerVolumeAttachScenarioOldVersion-709483818 None] Lock "cinder-9f83d0be-7cd4-4e13-802d-15920ac8336e-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:36 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" returned: 0 in 0.463s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:23:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:23:36 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:23:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:36 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 Nov 05 22:23:36 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:45 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=32,cinder:SELECT=44,cinder:DELETE=4,cinder:INSERT=5 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:23:46 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=49,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:23:46 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0" returned: 0 in 10.182s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:46 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923, size 1024.00 MB, duration 10.18 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:23:46 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Converted 1024.00 MB image at 100.55 MB/s Nov 05 22:23:46 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 is being set with open permissions: ugo+rw Nov 05 22:23:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:46 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 Nov 05 22:23:46 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:47 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0" returned: 0 in 1.088s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-bc0ef837-c13f-4eae-8e32-02d708f868b0" released by "_copy_volume_from_snapshot" :: held 12.343s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-3f63cc76-3d7f-4f78-8501-15163d177598-bc0ef837-c13f-4eae-8e32-02d708f868b0" released by "_create_volume_from_snapshot" :: held 12.484s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.507s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753bec8d-f943-47b1-bc16-2e6272f0422f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0ef837-c13f-4eae-8e32-02d708f868b0', 'volume_size': 2, 'snapshot_id': '3f63cc76-3d7f-4f78-8501-15163d177598'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1ef3cf-84c5-4ca4-bc71-5fc21732ccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 (bc0ef837-c13f-4eae-8e32-02d708f868b0): created successfully Nov 05 22:23:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1ef3cf-84c5-4ca4-bc71-5fc21732ccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Flow 'volume_create_manager' (1df7dfc1-4b35-4194-9f86-d0ae66a0992d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-112ad2f3-4362-4a8e-8440-7bb27cb02b95 tempest-VolumesSnapshotTestJSON-2006061401 None] Created volume successfully. Nov 05 22:23:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-bc0ef837-c13f-4eae-8e32-02d708f868b0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-bc0ef837-c13f-4eae-8e32-02d708f868b0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-bc0ef837-c13f-4eae-8e32-02d708f868b0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-bc0ef837-c13f-4eae-8e32-02d708f868b0" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[07723a56-bbc2-4da1-9647-6a30fc7e60c3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:49 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 Nov 05 22:23:49 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:50 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0" returned: 0 in 1.103s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:50 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0 Nov 05 22:23:50 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:51 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bc0ef837-c13f-4eae-8e32-02d708f868b0" returned: 0 in 0.548s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-bc0ef837-c13f-4eae-8e32-02d708f868b0" released by "delete_volume" :: held 1.754s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Created reservations ['b037a3a4-20c7-4c1e-9802-7bdc906a2112', '1f429845-a94f-4dd0-804e-8b77ce4dd814', '7c27bfbd-052b-4c70-a633-97f379472492', 'b0fb0950-a08e-45bf-83af-f50210c6b90f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:51 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:23:51 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-3f63cc76-3d7f-4f78-8501-15163d177598-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-3f63cc76-3d7f-4f78-8501-15163d177598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:51 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-3f63cc76-3d7f-4f78-8501-15163d177598" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.659s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Deleted volume successfully. Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-3f63cc76-3d7f-4f78-8501-15163d177598" acquired by "_delete_snapshot" :: waited 0.087s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Deleting offline snapshot 3f63cc76-3d7f-4f78-8501-15163d177598 of volume 5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:23:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] snapshot_file for this snap is: volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:23:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1305128c-a21c-486d-a61f-79efbe13b5ed tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-bc0ef837-c13f-4eae-8e32-02d708f868b0-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc65af8-9cef-4b30-8447-ecd722f3de36]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:52 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 Nov 05 22:23:52 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:52 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598" returned: 0 in 0.654s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:23:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[014e5c50-4d89-4e13-8d78-b98084b7fd20]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:52 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 Nov 05 22:23:52 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:53 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" returned: 0 in 0.932s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:53 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 Nov 05 22:23:53 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:54 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598" returned: 0 in 0.373s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:54 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598 Nov 05 22:23:54 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:54 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923.3f63cc76-3d7f-4f78-8501-15163d177598" returned: 0 in 0.334s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-3f63cc76-3d7f-4f78-8501-15163d177598" released by "_delete_snapshot" :: held 2.498s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" released by "delete_snapshot" :: held 2.594s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Created reservations ['06d797fd-2f47-41b8-8be9-8bd9cfda1412', '8077d299-6e34-4781-8540-a5b011af8afa', 'da018564-04f7-4b6e-89ed-9d898bb54a88', '8ba2095f-cef5-47ac-80d9-27dcad394d4a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Delete snapshot completed successfully. Nov 05 22:23:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bfd4c84e-0376-4747-a469-5829dc926ab1 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-3f63cc76-3d7f-4f78-8501-15163d177598-delete_snapshot" released by "delete_snapshot" :: held 3.055s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:55 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e3195c-b9cd-4d9b-84fb-ab156e23e91c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:55 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 Nov 05 22:23:55 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:56 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" returned: 0 in 0.755s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:56 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923 Nov 05 22:23:56 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:56 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" returned: 0 in 0.327s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923" released by "delete_volume" :: held 1.183s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Created reservations ['695685cb-b484-4eac-bf05-d5a54bc2ffd5', '0dfd5fe5-7175-4f3d-a1e2-c576084c523e', 'e891d912-ec57-4171-a9c6-c03e3725c24b', '9dfc6aee-c4bc-4b47-a78d-562536aa7661'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:56 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:23:56 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:57 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.420s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Deleted volume successfully. Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-86d3451d-f32a-449e-8821-d69b1b56c209 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-5c9c6a6f-d6c9-4717-aaa0-66c30ad8c923-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:57 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:23:57 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:57 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Flow 'volume_create_manager' (36dcac20-242d-4b57-ba12-2906e9989916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2edf31-d21a-4814-8250-6c9c665567ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2edf31-d21a-4814-8250-6c9c665567ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-183915404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a13ba6c9b8460bafdbae3d3d036b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:59Z,use_quota=True,user_id='fde9952e637b466185abb7d3a3f8850d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641c5219-9821-46fc-b165-8e4234c900e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641c5219-9821-46fc-b165-8e4234c900e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5157fe-17e9-460b-906d-f255b563804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5157fe-17e9-460b-906d-f255b563804a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf', 'volume_name': 'volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f910b72c-1e82-4a98-bbfa-47733bb25ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f910b72c-1e82-4a98-bbfa-47733bb25ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514dece8-c767-4438-95fd-abef6c2617d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume 41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf', 'volume_size': 1} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-183915404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a13ba6c9b8460bafdbae3d3d036b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:59Z,use_quota=True,user_id='fde9952e637b466185abb7d3a3f8850d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Creating volume 41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:58 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:23:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:58 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf 1073741824 Nov 05 22:23:58 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:59 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf 1073741824" returned: 0 in 0.743s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:59 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf Nov 05 22:23:59 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:59 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:23:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514dece8-c767-4438-95fd-abef6c2617d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913f6d16-49c4-4c00-833f-58269d437096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf (41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf): created successfully Nov 05 22:23:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913f6d16-49c4-4c00-833f-58269d437096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Flow 'volume_create_manager' (36dcac20-242d-4b57-ba12-2906e9989916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-004b647b-003e-4373-aea1-da4e39530590 tempest-VolumesSnapshotTestJSON-2006061401 None] Created volume successfully. Nov 05 22:24:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Creating offline snapshot 273251e2-745a-43f5-9a8e-aa2a84b82d0c of volume 41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:24:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a5d56-195d-494f-9fe5-209523bb7e11]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:01 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf Nov 05 22:24:01 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:01 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" returned: 0 in 0.477s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:01 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c 1G Nov 05 22:24:01 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:01 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c 1G" returned: 0 in 0.467s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:01 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c Nov 05 22:24:01 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:02 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c" returned: 0 in 0.309s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:02 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c is being set with open permissions: ugo+rw Nov 05 22:24:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:02 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c Nov 05 22:24:02 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:02 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c" returned: 0 in 0.301s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:02 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.info Nov 05 22:24:02 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:02 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.info" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:02 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.info is being set with open permissions: ugo+rw Nov 05 22:24:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:02 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.info Nov 05 22:24:02 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:03 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.info" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a30eee89-f1fe-4bab-93c7-c3dc4d5de843 tempest-VolumesSnapshotTestJSON-2006061401 None] Create snapshot completed successfully Nov 05 22:24:04 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Flow 'volume_create_manager' (98cc446f-e3a0-42f4-bb4c-e86ba7b75e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff8d999-ad3f-41e3-a6f4-7d9c55e3e2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff8d999-ad3f-41e3-a6f4-7d9c55e3e2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-827868981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b9964a-4618-47ef-b30c-dd2243d49257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a13ba6c9b8460bafdbae3d3d036b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=273251e2-745a-43f5-9a8e-aa2a84b82d0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:05Z,use_quota=True,user_id='fde9952e637b466185abb7d3a3f8850d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42c3a94-4858-4966-93ee-6906284c2c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42c3a94-4858-4966-93ee-6906284c2c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5dd9446-db30-4422-abbd-244a5d6b78e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5dd9446-db30-4422-abbd-244a5d6b78e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '02b9964a-4618-47ef-b30c-dd2243d49257', 'volume_name': 'volume-02b9964a-4618-47ef-b30c-dd2243d49257', 'volume_size': 1, 'snapshot_id': '273251e2-745a-43f5-9a8e-aa2a84b82d0c'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad16962-d815-4928-b713-1a3030caed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad16962-d815-4928-b713-1a3030caed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fb97f2-5f57-4fe3-894f-049725d91ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:05 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume 02b9964a-4618-47ef-b30c-dd2243d49257: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-02b9964a-4618-47ef-b30c-dd2243d49257', 'volume_size': 1, 'snapshot_id': '273251e2-745a-43f5-9a8e-aa2a84b82d0c'} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-273251e2-745a-43f5-9a8e-aa2a84b82d0c-02b9964a-4618-47ef-b30c-dd2243d49257" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-273251e2-745a-43f5-9a8e-aa2a84b82d0c-02b9964a-4618-47ef-b30c-dd2243d49257" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Creating volume 02b9964a-4618-47ef-b30c-dd2243d49257 from snapshot 273251e2-745a-43f5-9a8e-aa2a84b82d0c {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-02b9964a-4618-47ef-b30c-dd2243d49257" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-02b9964a-4618-47ef-b30c-dd2243d49257" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] snapshot: 273251e2-745a-43f5-9a8e-aa2a84b82d0c, volume: 02b9964a-4618-47ef-b30c-dd2243d49257, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64950eaf-8c21-48d9-8e65-8ac0c1665920]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:05 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c Nov 05 22:24:05 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Flow 'volume_create_manager' (93138510-7102-43f6-9e8e-b0873631179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3117e211-31f3-4a0c-a99c-bb99dd2a04ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3117e211-31f3-4a0c-a99c-bb99dd2a04ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585526815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde4bb4b83f143d2a0866ca750ae1636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:05Z,use_quota=True,user_id='d1c8adf9c21640e9972bfba4c003fd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc8855d-1dcd-4a76-9438-8405b1d042c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc8855d-1dcd-4a76-9438-8405b1d042c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a31819-9bb1-4b79-95c8-6194b0924657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29a31819-9bb1-4b79-95c8-6194b0924657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0', 'volume_name': 'volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e52fc5-5b0f-4579-af88-1fa998ed3a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e52fc5-5b0f-4579-af88-1fa998ed3a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91240ffe-3d97-4446-aaca-8c54fca9e550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:05 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Volume bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0', 'volume_size': 1} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:05 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c" returned: 0 in 0.495s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[866dadd8-a23e-47e0-a9c4-cd9d3f9e59a8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:05 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf Nov 05 22:24:05 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Flow 'volume_create_manager' (e2ef9f57-af92-45b8-aa91-88fdcfba7661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e85447-2d70-43e1-82b5-dd714592111a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e85447-2d70-43e1-82b5-dd714592111a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-313800019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6adb18-c979-4d04-be71-26fe4b977dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde4bb4b83f143d2a0866ca750ae1636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:06Z,use_quota=True,user_id='d1c8adf9c21640e9972bfba4c003fd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a222b6f6-d56f-4cc7-88cc-9abfdf95a629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a222b6f6-d56f-4cc7-88cc-9abfdf95a629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:05 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f26227-8b7f-451b-826b-89f7269e2955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f26227-8b7f-451b-826b-89f7269e2955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a6adb18-c979-4d04-be71-26fe4b977dbd', 'volume_name': 'volume-9a6adb18-c979-4d04-be71-26fe4b977dbd', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8468b51a-d539-4dd5-b32e-882ae0b96044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8468b51a-d539-4dd5-b32e-882ae0b96044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b621c84-0cc8-4f5b-9079-3e9a2d013e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Volume 9a6adb18-c979-4d04-be71-26fe4b977dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a6adb18-c979-4d04-be71-26fe4b977dbd', 'volume_size': 1} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:06 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" returned: 0 in 0.554s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:06 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 Nov 05 22:24:06 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Flow 'volume_create_manager' (c489b2b7-a603-4e3a-8b25-426f8299df1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b304b27-b585-4f22-8ae1-96bb9e8d48ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b304b27-b585-4f22-8ae1-96bb9e8d48ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2126677067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8872bae3-b251-48d9-8318-8fc34b392f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde4bb4b83f143d2a0866ca750ae1636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:06Z,use_quota=True,user_id='d1c8adf9c21640e9972bfba4c003fd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74f241a-4cb4-473e-979a-603516f9c5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74f241a-4cb4-473e-979a-603516f9c5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9702163b-55e3-4229-b6d8-4e65e40e9924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9702163b-55e3-4229-b6d8-4e65e40e9924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8872bae3-b251-48d9-8318-8fc34b392f04', 'volume_name': 'volume-8872bae3-b251-48d9-8318-8fc34b392f04', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4bd819-eee2-4fcb-9b5a-467b6899366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4bd819-eee2-4fcb-9b5a-467b6899366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91814f88-04d9-4153-8c62-b367305e2aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Volume 8872bae3-b251-48d9-8318-8fc34b392f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8872bae3-b251-48d9-8318-8fc34b392f04', 'volume_size': 1} Nov 05 22:24:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Flow 'volume_create_manager' (d527d760-830f-4636-a97e-afca2b4d12d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa908a4e-923d-49d6-b420-c267ef0305b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa908a4e-923d-49d6-b420-c267ef0305b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123176800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde4bb4b83f143d2a0866ca750ae1636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:07Z,use_quota=True,user_id='d1c8adf9c21640e9972bfba4c003fd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ed613c-a1d0-4b95-9586-06b4c79cfc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ed613c-a1d0-4b95-9586-06b4c79cfc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c6bc4a-5378-4d49-8025-8891143f35ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c6bc4a-5378-4d49-8025-8891143f35ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7', 'volume_name': 'volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0c8762-937d-4c31-a5df-4c565e11a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0c8762-937d-4c31-a5df-4c565e11a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb423905-48ec-49b4-8b20-7e213df04ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Volume 5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7', 'volume_size': 1} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Flow 'volume_create_manager' (042484eb-fcf4-4f69-afd6-4d19582689b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ed0145-6c51-4471-ab83-2f42dd2080fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ed0145-6c51-4471-ab83-2f42dd2080fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-109490051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367aef0b-bf75-4713-abc5-7b68f879fde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde4bb4b83f143d2a0866ca750ae1636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:08Z,use_quota=True,user_id='d1c8adf9c21640e9972bfba4c003fd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23fecb3-b7b9-443b-85ed-8135b67210f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23fecb3-b7b9-443b-85ed-8135b67210f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d9846f-3909-4a1a-b213-15f4672d4324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d9846f-3909-4a1a-b213-15f4672d4324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '367aef0b-bf75-4713-abc5-7b68f879fde1', 'volume_name': 'volume-367aef0b-bf75-4713-abc5-7b68f879fde1', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d172f9-932e-42b2-91a1-53b57d170c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d172f9-932e-42b2-91a1-53b57d170c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6408b1-1087-48cd-b8dd-86c3045c5426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Volume 367aef0b-bf75-4713-abc5-7b68f879fde1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-367aef0b-bf75-4713-abc5-7b68f879fde1', 'volume_size': 1} Nov 05 22:24:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Flow 'volume_create_manager' (b0104a1f-4f68-4175-8de1-eb9235712ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc56d23e-3a63-4e0c-b9ab-22aac323e28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc56d23e-3a63-4e0c-b9ab-22aac323e28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1278168423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1522953f-e3da-405b-929f-4c7d11d7d27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a105a01daeb8457ab70a2adbb25789e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:12Z,use_quota=True,user_id='1257470090d34a63aa80b428a5f66ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699a3362-7867-4684-a897-fee2e6b746f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699a3362-7867-4684-a897-fee2e6b746f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837b10de-0e37-4f91-8918-5ed101cc1c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837b10de-0e37-4f91-8918-5ed101cc1c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1522953f-e3da-405b-929f-4c7d11d7d27b', 'volume_name': 'volume-1522953f-e3da-405b-929f-4c7d11d7d27b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43aec137-4fdb-40a5-9034-61c210272a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43aec137-4fdb-40a5-9034-61c210272a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ed86cc-4789-468e-8d19-4415c2820c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:11 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Volume 1522953f-e3da-405b-929f-4c7d11d7d27b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1522953f-e3da-405b-929f-4c7d11d7d27b', 'volume_size': 1} Nov 05 22:24:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:13 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257" returned: 0 in 7.138s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:24:13 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Converted 1024.00 MB image at 143.43 MB/s Nov 05 22:24:13 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 is being set with open permissions: ugo+rw Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:13 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 Nov 05 22:24:13 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:13 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-02b9964a-4618-47ef-b30c-dd2243d49257" released by "_copy_volume_from_snapshot" :: held 8.553s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-273251e2-745a-43f5-9a8e-aa2a84b82d0c-02b9964a-4618-47ef-b30c-dd2243d49257" released by "_create_volume_from_snapshot" :: held 8.623s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.644s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.135s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585526815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde4bb4b83f143d2a0866ca750ae1636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:05Z,use_quota=True,user_id='d1c8adf9c21640e9972bfba4c003fd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Creating volume bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:13 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:13 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 1073741824 Nov 05 22:24:13 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fb97f2-5f57-4fe3-894f-049725d91ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b9964a-4618-47ef-b30c-dd2243d49257', 'volume_size': 1, 'snapshot_id': '273251e2-745a-43f5-9a8e-aa2a84b82d0c'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cdf634-1679-43a5-b6bb-fea43013fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Volume volume-02b9964a-4618-47ef-b30c-dd2243d49257 (02b9964a-4618-47ef-b30c-dd2243d49257): created successfully Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cdf634-1679-43a5-b6bb-fea43013fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Flow 'volume_create_manager' (98cc446f-e3a0-42f4-bb4c-e86ba7b75e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c6eb5289-6e86-4d68-a299-26d6d9a630d6 tempest-VolumesSnapshotTestJSON-2006061401 None] Created volume successfully. Nov 05 22:24:14 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 1073741824" returned: 0 in 0.455s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:14 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 Nov 05 22:24:14 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:14 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.414s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-313800019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6adb18-c979-4d04-be71-26fe4b977dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde4bb4b83f143d2a0866ca750ae1636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:06Z,use_quota=True,user_id='d1c8adf9c21640e9972bfba4c003fd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Creating volume 9a6adb18-c979-4d04-be71-26fe4b977dbd {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:14 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91240ffe-3d97-4446-aaca-8c54fca9e550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290ce7bd-2e94-4e87-aca5-b72142e4e100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:14 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd 1073741824 Nov 05 22:24:14 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Volume volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 (bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0): created successfully Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (290ce7bd-2e94-4e87-aca5-b72142e4e100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Flow 'volume_create_manager' (93138510-7102-43f6-9e8e-b0873631179d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5b971fe3-b265-4a5e-8220-9deb69bc1742 tempest-CreateVolumesFromImageTest-306586913 None] Created volume successfully. Nov 05 22:24:14 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd 1073741824" returned: 0 in 0.450s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-02b9964a-4618-47ef-b30c-dd2243d49257-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-02b9964a-4618-47ef-b30c-dd2243d49257-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:14 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd Nov 05 22:24:14 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-02b9964a-4618-47ef-b30c-dd2243d49257" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-02b9964a-4618-47ef-b30c-dd2243d49257" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac6eee-40e2-4e6b-9f15-3f3f0a1a56d7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:15 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 Nov 05 22:24:15 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:15 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.636s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2126677067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8872bae3-b251-48d9-8318-8fc34b392f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde4bb4b83f143d2a0866ca750ae1636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:06Z,use_quota=True,user_id='d1c8adf9c21640e9972bfba4c003fd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Creating volume 8872bae3-b251-48d9-8318-8fc34b392f04 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:15 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b621c84-0cc8-4f5b-9079-3e9a2d013e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6adb18-c979-4d04-be71-26fe4b977dbd', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5864698a-9443-4de0-b54f-23969dc48d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:15 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04 1073741824 Nov 05 22:24:15 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Volume volume-9a6adb18-c979-4d04-be71-26fe4b977dbd (9a6adb18-c979-4d04-be71-26fe4b977dbd): created successfully Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5864698a-9443-4de0-b54f-23969dc48d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Flow 'volume_create_manager' (e2ef9f57-af92-45b8-aa91-88fdcfba7661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0e0e9f5e-301a-4dbd-8382-f6925d5c7c4c tempest-CreateVolumesFromImageTest-306586913 None] Created volume successfully. Nov 05 22:24:15 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257" returned: 0 in 0.393s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:15 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257 Nov 05 22:24:15 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:15 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04 1073741824" returned: 0 in 0.423s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:15 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-02b9964a-4618-47ef-b30c-dd2243d49257" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-02b9964a-4618-47ef-b30c-dd2243d49257" released by "delete_volume" :: held 0.684s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:15 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04 Nov 05 22:24:15 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Created reservations ['91c808bb-05ca-4e2e-a5a0-99b3270898f2', 'bd602234-02e2-46b4-8a65-ea9b25ca33b1', '0429d102-4d0b-4ca5-b267-9b256ce1d8bb', 'c9a94be3-4b04-4fa9-a4b8-90b2a4fcf4a4'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:15 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:24:15 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:15 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.765s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123176800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde4bb4b83f143d2a0866ca750ae1636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:07Z,use_quota=True,user_id='d1c8adf9c21640e9972bfba4c003fd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Creating volume 5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:15 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91814f88-04d9-4153-8c62-b367305e2aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8872bae3-b251-48d9-8318-8fc34b392f04', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d9fbe4-66bf-49d8-84d5-abf6754e5848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:16 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 1073741824 Nov 05 22:24:16 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Volume volume-8872bae3-b251-48d9-8318-8fc34b392f04 (8872bae3-b251-48d9-8318-8fc34b392f04): created successfully Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d9fbe4-66bf-49d8-84d5-abf6754e5848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Flow 'volume_create_manager' (c489b2b7-a603-4e3a-8b25-426f8299df1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-17c3ce7d-6fd2-48ae-aa86-349c6ca32665 tempest-CreateVolumesFromImageTest-306586913 None] Created volume successfully. Nov 05 22:24:16 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Deleted volume successfully. Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01481ab4-4ab0-4f64-90a9-8ae001d4376c tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-02b9964a-4618-47ef-b30c-dd2243d49257-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-273251e2-745a-43f5-9a8e-aa2a84b82d0c-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-273251e2-745a-43f5-9a8e-aa2a84b82d0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-273251e2-745a-43f5-9a8e-aa2a84b82d0c" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-273251e2-745a-43f5-9a8e-aa2a84b82d0c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Deleting offline snapshot 273251e2-745a-43f5-9a8e-aa2a84b82d0c of volume 41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] snapshot_file for this snap is: volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae06036-b04a-4ab2-8819-d31956c02047]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:16 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c Nov 05 22:24:16 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:16 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 1073741824" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:16 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 Nov 05 22:24:16 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:16 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c" returned: 0 in 0.379s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad561582-2331-43bd-8684-0a8fedd63840]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:16 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf Nov 05 22:24:16 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:16 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.947s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-109490051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367aef0b-bf75-4713-abc5-7b68f879fde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde4bb4b83f143d2a0866ca750ae1636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:08Z,use_quota=True,user_id='d1c8adf9c21640e9972bfba4c003fd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Creating volume 367aef0b-bf75-4713-abc5-7b68f879fde1 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:16 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb423905-48ec-49b4-8b20-7e213df04ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924dc71f-f3eb-45f2-896c-8e6e03016801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:16 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1 1073741824 Nov 05 22:24:16 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Volume volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 (5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7): created successfully Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924dc71f-f3eb-45f2-896c-8e6e03016801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Flow 'volume_create_manager' (d527d760-830f-4636-a97e-afca2b4d12d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-da272883-b687-41de-9cd7-ee0c8a4e4923 tempest-CreateVolumesFromImageTest-306586913 None] Created volume successfully. Nov 05 22:24:17 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1 1073741824" returned: 0 in 0.425s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:17 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" returned: 0 in 0.620s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:17 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1 Nov 05 22:24:17 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:17 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c Nov 05 22:24:17 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:17 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.768s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1278168423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1522953f-e3da-405b-929f-4c7d11d7d27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a105a01daeb8457ab70a2adbb25789e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:12Z,use_quota=True,user_id='1257470090d34a63aa80b428a5f66ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Creating volume 1522953f-e3da-405b-929f-4c7d11d7d27b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:17 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:17 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b 1073741824 Nov 05 22:24:17 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6408b1-1087-48cd-b8dd-86c3045c5426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-367aef0b-bf75-4713-abc5-7b68f879fde1', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf497359-83e9-4321-a576-2f262f1ce528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Volume volume-367aef0b-bf75-4713-abc5-7b68f879fde1 (367aef0b-bf75-4713-abc5-7b68f879fde1): created successfully Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf497359-83e9-4321-a576-2f262f1ce528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Flow 'volume_create_manager' (042484eb-fcf4-4f69-afd6-4d19582689b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9cd9f35d-7ab3-47ff-b55e-c50bf7361a61 tempest-CreateVolumesFromImageTest-306586913 None] Created volume successfully. Nov 05 22:24:17 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c" returned: 0 in 0.398s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:17 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c Nov 05 22:24:17 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:17 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf.273251e2-745a-43f5-9a8e-aa2a84b82d0c" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:17 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-273251e2-745a-43f5-9a8e-aa2a84b82d0c" released by "_delete_snapshot" :: held 1.773s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b 1073741824" returned: 0 in 0.451s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" released by "delete_snapshot" :: held 1.794s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:18 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b Nov 05 22:24:18 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Created reservations ['f3902b3e-f120-474d-bee6-3d17634b6b28', '244ce23c-8f03-4fc1-adca-e3c882403eba', 'a1fe7197-fbf5-4dbf-b909-bdb23f3332d4', '94df8977-ca5c-45ff-946d-898252eadd38'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Delete snapshot completed successfully. Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43fcd0e0-906e-4d1b-9b0b-1e05be7c1ee9 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-273251e2-745a-43f5-9a8e-aa2a84b82d0c-delete_snapshot" released by "delete_snapshot" :: held 1.955s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:18 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ed86cc-4789-468e-8d19-4415c2820c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1522953f-e3da-405b-929f-4c7d11d7d27b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9dec9b-2ba0-490c-a548-d387e50f5754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Volume volume-1522953f-e3da-405b-929f-4c7d11d7d27b (1522953f-e3da-405b-929f-4c7d11d7d27b): created successfully Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9dec9b-2ba0-490c-a548-d387e50f5754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Flow 'volume_create_manager' (b0104a1f-4f68-4175-8de1-eb9235712ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6af39892-c441-4ffc-8dc2-a3b3c60fb258 tempest-AttachVolumeNegativeTest-1784142477 None] Created volume successfully. Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810ca68-05dd-47e8-a178-17c4f66c3d59]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:18 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf Nov 05 22:24:18 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "cinder-367aef0b-bf75-4713-abc5-7b68f879fde1-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-367aef0b-bf75-4713-abc5-7b68f879fde1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "cinder-quobyte-367aef0b-bf75-4713-abc5-7b68f879fde1" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-quobyte-367aef0b-bf75-4713-abc5-7b68f879fde1" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d02d71c-274e-416c-ab81-d3a69d89c6ae]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:18 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:18 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf Nov 05 22:24:18 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:18 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1 Nov 05 22:24:18 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:19 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" returned: 0 in 0.264s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf" released by "delete_volume" :: held 0.725s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Created reservations ['a9fba26f-b7b9-4ed0-9794-1c564ae5fc52', 'bde37a04-c34f-4e77-b2d5-19c64adea74e', '2e2421e4-1153-4a6d-a9d0-5bc65963ce1e', '76ca9991-0ff5-4dba-9938-50e942f2a978'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:19 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1" returned: 0 in 0.449s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:19 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1 Nov 05 22:24:19 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:19 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:24:19 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:19 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-367aef0b-bf75-4713-abc5-7b68f879fde1" returned: 0 in 0.375s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-quobyte-367aef0b-bf75-4713-abc5-7b68f879fde1" released by "delete_volume" :: held 0.874s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:19 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.356s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Deleted volume successfully. Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "cinder-quobyte-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-431677bf-79b6-4d6f-b9b6-54802258b62f tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-41ddc825-b0c1-45d8-87eb-8d6a2ee5b6cf-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b0bab-37c1-436f-86d1-fff90125de97]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7b42d101-1676-4132-b491-84eee61eee46 req-e6f433ab-50ac-4877-8e7e-e7089df32a17 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7b42d101-1676-4132-b491-84eee61eee46 req-e6f433ab-50ac-4877-8e7e-e7089df32a17 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Created reservations ['fe37eca2-596d-4c96-a068-d34ccb9f1d15', 'a848d7c1-09f0-4c73-90ae-5081ed8640eb', '9671badd-50d5-4b9e-9967-6284d3e25616', '468b2ed8-897f-4c8a-8c68-002f69ae1661'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-7b42d101-1676-4132-b491-84eee61eee46 req-e6f433ab-50ac-4877-8e7e-e7089df32a17 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-7b42d101-1676-4132-b491-84eee61eee46 req-e6f433ab-50ac-4877-8e7e-e7089df32a17 tempest-AttachVolumeNegativeTest-1784142477 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-1522953f-e3da-405b-929f-4c7d11d7d27b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0275415a-97fa-41ee-b77e-26f8df4d32f7', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:24:19 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf Nov 05 22:24:19 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:19 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:24:19 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-7b42d101-1676-4132-b491-84eee61eee46 req-e6f433ab-50ac-4877-8e7e-e7089df32a17 tempest-AttachVolumeNegativeTest-1784142477 None] attachment_update completed successfully. Nov 05 22:24:20 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" returned: 0 in 0.395s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:20 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf Nov 05 22:24:20 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:20 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.289s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Deleted volume successfully. Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8af7e13d-2d53-4cc0-b976-e1b5c0c93c32 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-367aef0b-bf75-4713-abc5-7b68f879fde1-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:20 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-quobyte-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf" released by "delete_volume" :: held 0.799s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Created reservations ['4a8b9ff8-6481-4d98-bf18-1260c0e562dd', '5f58cf53-028e-4368-a420-04bcdd62bc15', '475cf179-bbaa-4b90-afc6-72b6434a184d', '964ea58e-7bdc-4167-a716-47c1e4c67a58'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:20 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:24:20 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:20 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:20 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Deleted volume successfully. Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-38361390-0c77-47f2-bf1a-9f93b7b9eb98 tempest-VolumesSnapshotTestJSON-2006061401 None] Lock "cinder-87f4189e-b3b1-4f69-83ce-a0a5adf4bcdf-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "cinder-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "cinder-quobyte-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-quobyte-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[77291c83-bd44-403b-af19-ac3323b26a39]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:21 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 Nov 05 22:24:21 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:21 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7" returned: 0 in 0.485s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:21 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7 Nov 05 22:24:21 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:21 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-quobyte-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7" released by "delete_volume" :: held 0.853s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Created reservations ['73efc27c-4f8a-4821-b45c-0eb91ec3eea2', 'a5dbff29-1a48-4329-ae68-62b5e21c9c12', '0e9c5e88-649c-4643-ac8a-e8d3c962729c', '61b6d925-d95e-4516-a5a5-66c3d998e2dc'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:22 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:24:22 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "cinder-8872bae3-b251-48d9-8318-8fc34b392f04-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-8872bae3-b251-48d9-8318-8fc34b392f04-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "cinder-quobyte-8872bae3-b251-48d9-8318-8fc34b392f04" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-quobyte-8872bae3-b251-48d9-8318-8fc34b392f04" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc4c1f5-bbec-46a8-afc0-b4162efcf51d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:22 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Deleted volume successfully. Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9c9fc53a-2195-4d8c-ad01-4e6d05fdff86 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-5fdc1167-4b4e-4be8-8675-b2a4d7fb98e7-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:22 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04 Nov 05 22:24:22 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:22 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04" returned: 0 in 0.410s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:22 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04 Nov 05 22:24:22 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:23 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8872bae3-b251-48d9-8318-8fc34b392f04" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-quobyte-8872bae3-b251-48d9-8318-8fc34b392f04" released by "delete_volume" :: held 0.768s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Created reservations ['1d6f3417-a995-4e5f-98d6-f586a00fe913', '063b3166-24e8-4c6a-bf66-a3a77c9e0734', 'a659d593-a88b-4014-98b3-980838e8ee84', '71a40f3e-252b-49fe-98ca-33b520db346d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:23 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:24:23 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "cinder-9a6adb18-c979-4d04-be71-26fe4b977dbd-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-9a6adb18-c979-4d04-be71-26fe4b977dbd-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "cinder-quobyte-9a6adb18-c979-4d04-be71-26fe4b977dbd" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-quobyte-9a6adb18-c979-4d04-be71-26fe4b977dbd" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:23 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Deleted volume successfully. Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ff0f3-718e-453e-870b-e18b26431b18]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b37e17ba-8192-4285-a962-69bde1a90c95 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-8872bae3-b251-48d9-8318-8fc34b392f04-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:23 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd Nov 05 22:24:23 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:24 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd" returned: 0 in 0.391s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:24 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd Nov 05 22:24:24 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:24 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9a6adb18-c979-4d04-be71-26fe4b977dbd" returned: 0 in 0.281s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-quobyte-9a6adb18-c979-4d04-be71-26fe4b977dbd" released by "delete_volume" :: held 0.742s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Created reservations ['bc0aae7c-5920-46c4-b496-5352494d1912', 'c606ba90-98fc-4a7f-bf60-42e49211651f', 'c118b44e-ffbb-484a-8699-75a2f6fcfc43', 'f952dc62-85ad-42d8-81ab-88624812dd5d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:24 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:24:24 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "cinder-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "cinder-quobyte-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-quobyte-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:24 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.341s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6d6514-7003-4afb-acf1-577134879cb6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Deleted volume successfully. Nov 05 22:24:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3610b7a-a67d-4a32-b25a-50890f847b15 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-9a6adb18-c979-4d04-be71-26fe4b977dbd-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:25 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 Nov 05 22:24:25 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:25 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0" returned: 0 in 0.559s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:25 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0 Nov 05 22:24:25 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:25 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0" returned: 0 in 0.334s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-quobyte-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0" released by "delete_volume" :: held 0.975s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:25 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Created reservations ['1461179f-7aff-41d9-835c-eaf8fdd2c6a8', '7df6a155-bd29-4a8b-b305-5741d1110d3a', 'af7d33c3-4191-4144-9f58-745d04ead511', '910f791f-1479-40c2-8e74-cf532f23cbdc'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:26 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:24:26 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:26 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:26 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Deleted volume successfully. Nov 05 22:24:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a3960de0-8657-47bb-bd44-d4f65179a5f4 tempest-CreateVolumesFromImageTest-306586913 None] Lock "cinder-bf7e601c-98ab-48d8-8a8b-4f0fe95c84d0-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-0a96dac8-a1bd-40a9-b57e-6bdaf17aa6f6 tempest-TestShelveInstance-2097281360 None] Terminate volume connection completed successfully. Nov 05 22:24:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-0a96dac8-a1bd-40a9-b57e-6bdaf17aa6f6 tempest-TestShelveInstance-2097281360 None] Deleting attachment f7b5406c-7130-4037-ae2c-02d3bc24f2ec. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:24:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Acquiring lock "cinder-4f5a28f8-ab61-4489-bb20-181defd1307b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Lock "cinder-4f5a28f8-ab61-4489-bb20-181defd1307b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Acquiring lock "cinder-quobyte-4f5a28f8-ab61-4489-bb20-181defd1307b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Lock "cinder-quobyte-4f5a28f8-ab61-4489-bb20-181defd1307b" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e458772e-f9f0-4ec6-b2cb-6d90c02dc518]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:33 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b Nov 05 22:24:33 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:33 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b" returned: 0 in 0.572s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:33 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b Nov 05 22:24:33 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:33 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f5a28f8-ab61-4489-bb20-181defd1307b" returned: 0 in 0.430s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Lock "cinder-quobyte-4f5a28f8-ab61-4489-bb20-181defd1307b" released by "delete_volume" :: held 1.106s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG cinder.quota [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Created reservations ['ee063164-a89a-4f21-b9ae-de1539ff4f57', '97ebab4b-77bf-4b6b-b0ab-d25d93dae881', 'f5461659-5113-4a21-8c2f-5d5104f5e04e', '8adb5137-4ced-40d9-9beb-718432848ed4'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:34 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:24:34 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:34 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.419s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG cinder.manager [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Deleted volume successfully. Nov 05 22:24:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-30b5ef60-8a66-41c0-b2ad-e2fe69156563 req-6dfab0a5-f86f-430b-9e1f-a8ddfc509678 tempest-TestShelveInstance-2097281360 None] Lock "cinder-4f5a28f8-ab61-4489-bb20-181defd1307b-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=85,cinder:INSERT=32,cinder:UPDATE=130,cinder:DELETE=9 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=109,cinder:UPDATE=129,cinder:DELETE=12,cinder:INSERT=30 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (6456b9bb-3aad-4d59-9bb7-59b6b7398e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9fa849-63a3-4124-9a7c-6795371fad40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9fa849-63a3-4124-9a7c-6795371fad40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-999832885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0000c48d-17d1-4ebc-a3ec-bdd62f416209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:50Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318a8f1b-6b9b-4833-abb5-d7c9ffd505ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (318a8f1b-6b9b-4833-abb5-d7c9ffd505ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830cce90-f01f-4c2c-83b7-4c91589179a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830cce90-f01f-4c2c-83b7-4c91589179a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0000c48d-17d1-4ebc-a3ec-bdd62f416209', 'volume_name': 'volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00f1ab7-0455-47ed-8a60-f29de94ec331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00f1ab7-0455-47ed-8a60-f29de94ec331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123aa8e1-bb90-4e12-bca8-528a939a3b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume 0000c48d-17d1-4ebc-a3ec-bdd62f416209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209', 'volume_size': 1} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-999832885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0000c48d-17d1-4ebc-a3ec-bdd62f416209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:50Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Creating volume 0000c48d-17d1-4ebc-a3ec-bdd62f416209 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:50 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:50 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209 1073741824 Nov 05 22:24:50 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:50 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209 1073741824" returned: 0 in 0.505s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:51 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209 Nov 05 22:24:51 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:51 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123aa8e1-bb90-4e12-bca8-528a939a3b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcca371-590a-4f59-a41e-2548d5754b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:51 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209 (0000c48d-17d1-4ebc-a3ec-bdd62f416209): created successfully Nov 05 22:24:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcca371-590a-4f59-a41e-2548d5754b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (6456b9bb-3aad-4d59-9bb7-59b6b7398e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-09bbc303-71ea-47ac-9d75-20a2fa7aa201 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created volume successfully. Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (4c69bf44-7bc5-46c1-8c75-f597a81abc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748bf641-fecf-498b-b777-749b51f56526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748bf641-fecf-498b-b777-749b51f56526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139697003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39658d88-bac5-4595-944b-ffd0b5030ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:53Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb9525e-71b0-4dbe-a41b-1a262520cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb9525e-71b0-4dbe-a41b-1a262520cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fef6012-6d31-462a-9054-771512610253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fef6012-6d31-462a-9054-771512610253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39658d88-bac5-4595-944b-ffd0b5030ac9', 'volume_name': 'volume-39658d88-bac5-4595-944b-ffd0b5030ac9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2614597b-3033-40da-8896-46921d2008bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2614597b-3033-40da-8896-46921d2008bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff7c64b-67cc-40bb-bef4-6a9013884fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:53 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume 39658d88-bac5-4595-944b-ffd0b5030ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39658d88-bac5-4595-944b-ffd0b5030ac9', 'volume_size': 1} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139697003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39658d88-bac5-4595-944b-ffd0b5030ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:53Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Creating volume 39658d88-bac5-4595-944b-ffd0b5030ac9 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:53 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:53 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9 1073741824 Nov 05 22:24:53 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (d9f6d930-6df1-4eb5-9ffe-e4577bacd8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a709ad-dd72-477a-af7a-143c4387ab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a709ad-dd72-477a-af7a-143c4387ab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1608017823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735ffa3c-3096-47d6-8335-84adb01431b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:53Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75803efc-5c28-4a0c-88ee-68312fc286b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75803efc-5c28-4a0c-88ee-68312fc286b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e76b2e8-b49d-4741-9924-265ded1f8a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e76b2e8-b49d-4741-9924-265ded1f8a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735ffa3c-3096-47d6-8335-84adb01431b0', 'volume_name': 'volume-735ffa3c-3096-47d6-8335-84adb01431b0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8a75ba-73a1-4f43-9354-cbcd257fcc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8a75ba-73a1-4f43-9354-cbcd257fcc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d11494-6328-45b3-a006-8da5fbc29d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:53 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume 735ffa3c-3096-47d6-8335-84adb01431b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735ffa3c-3096-47d6-8335-84adb01431b0', 'volume_size': 1} Nov 05 22:24:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:54 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9 1073741824" returned: 0 in 0.881s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (9df34e32-2460-4721-bd02-615adcb6124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28093d37-7097-4e92-b87f-38b8dd06eccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28093d37-7097-4e92-b87f-38b8dd06eccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1057431991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20eeb2af-2102-41b6-89f2-5581098d2f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:54Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3296f1c-93e5-4d5d-ac09-e68b14e9b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3296f1c-93e5-4d5d-ac09-e68b14e9b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1d8231-d6d3-4c69-b55c-c8e29cee023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9 Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1d8231-d6d3-4c69-b55c-c8e29cee023f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20eeb2af-2102-41b6-89f2-5581098d2f8b', 'volume_name': 'volume-20eeb2af-2102-41b6-89f2-5581098d2f8b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80f79b1-df6c-4d29-bf99-7553f21f5bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80f79b1-df6c-4d29-bf99-7553f21f5bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6630d8fe-3899-43c1-9783-40cf92eadef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume 20eeb2af-2102-41b6-89f2-5581098d2f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20eeb2af-2102-41b6-89f2-5581098d2f8b', 'volume_size': 1} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:54 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9" returned: 0 in 0.353s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.798s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1608017823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735ffa3c-3096-47d6-8335-84adb01431b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:53Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Creating volume 735ffa3c-3096-47d6-8335-84adb01431b0 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:54 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff7c64b-67cc-40bb-bef4-6a9013884fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39658d88-bac5-4595-944b-ffd0b5030ac9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0 1073741824 Nov 05 22:24:54 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f2b3df-ec44-4648-9aaa-3264944982d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume volume-39658d88-bac5-4595-944b-ffd0b5030ac9 (39658d88-bac5-4595-944b-ffd0b5030ac9): created successfully Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f2b3df-ec44-4648-9aaa-3264944982d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (4c69bf44-7bc5-46c1-8c75-f597a81abc53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (06a6f623-248f-46fe-bc0c-0193148bfab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79af48e2-21e4-4de0-801c-df5ca43daf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79af48e2-21e4-4de0-801c-df5ca43daf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1339380073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607511e2-2709-4c09-8bea-d038174991f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:55Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717b3ef9-06de-4462-bb21-99cd3429064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717b3ef9-06de-4462-bb21-99cd3429064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f41ae5cf-f696-47e0-92cd-ba1a3e49433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f41ae5cf-f696-47e0-92cd-ba1a3e49433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '607511e2-2709-4c09-8bea-d038174991f3', 'volume_name': 'volume-607511e2-2709-4c09-8bea-d038174991f3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c587b4-9c42-48a8-bea9-1e131a3d9680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c587b4-9c42-48a8-bea9-1e131a3d9680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db2fb82-3af1-4e48-be51-362f0eed148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume 607511e2-2709-4c09-8bea-d038174991f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-607511e2-2709-4c09-8bea-d038174991f3', 'volume_size': 1} Nov 05 22:24:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d6ae0fbb-4c45-4f6e-9365-a1ba566ee535 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created volume successfully. Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (00a004fe-0e2f-4136-ae96-1a14ad61e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6716952-d30d-4474-8121-6f5bbba0e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6716952-d30d-4474-8121-6f5bbba0e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482014856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8cacca-731e-4aa7-a41f-96a266df419c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:55Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45874206-4c8e-4ab5-8cec-b32a9f46cfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45874206-4c8e-4ab5-8cec-b32a9f46cfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a6a48b-be41-40b0-853d-7f59398008f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a6a48b-be41-40b0-853d-7f59398008f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e8cacca-731e-4aa7-a41f-96a266df419c', 'volume_name': 'volume-1e8cacca-731e-4aa7-a41f-96a266df419c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961f5d95-6149-4127-8157-af782209e2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961f5d95-6149-4127-8157-af782209e2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4339889e-bb69-453a-9201-c91ffe783be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume 1e8cacca-731e-4aa7-a41f-96a266df419c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e8cacca-731e-4aa7-a41f-96a266df419c', 'volume_size': 1} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:55 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0 1073741824" returned: 0 in 0.719s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:55 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0 Nov 05 22:24:55 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:55 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.407s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1057431991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20eeb2af-2102-41b6-89f2-5581098d2f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:54Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Creating volume 20eeb2af-2102-41b6-89f2-5581098d2f8b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:55 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:55 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b 1073741824 Nov 05 22:24:55 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d11494-6328-45b3-a006-8da5fbc29d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735ffa3c-3096-47d6-8335-84adb01431b0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621c150a-b7fd-4aa2-94cc-1edcac7586a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume volume-735ffa3c-3096-47d6-8335-84adb01431b0 (735ffa3c-3096-47d6-8335-84adb01431b0): created successfully Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621c150a-b7fd-4aa2-94cc-1edcac7586a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (d9f6d930-6df1-4eb5-9ffe-e4577bacd8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-229166f6-b063-4863-a64c-3154b18434f3 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created volume successfully. Nov 05 22:24:56 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b 1073741824" returned: 0 in 0.762s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:56 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b Nov 05 22:24:56 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:56 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b" returned: 0 in 0.318s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.143s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1339380073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607511e2-2709-4c09-8bea-d038174991f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:55Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Creating volume 607511e2-2709-4c09-8bea-d038174991f3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:56 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6630d8fe-3899-43c1-9783-40cf92eadef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20eeb2af-2102-41b6-89f2-5581098d2f8b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b84b22d-a54f-42c7-aa54-7668e2d37e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:56 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3 1073741824 Nov 05 22:24:56 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume volume-20eeb2af-2102-41b6-89f2-5581098d2f8b (20eeb2af-2102-41b6-89f2-5581098d2f8b): created successfully Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b84b22d-a54f-42c7-aa54-7668e2d37e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (9df34e32-2460-4721-bd02-615adcb6124f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ab02d929-c516-44af-9368-856412d79cee tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created volume successfully. Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:57 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:57 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3 1073741824" returned: 0 in 0.767s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:57 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:57 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3 Nov 05 22:24:57 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:57 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.334s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:24:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:24:58 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3" returned: 0 in 0.325s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.919s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482014856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8cacca-731e-4aa7-a41f-96a266df419c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de2466dce8d4698be53fbcace72313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:55Z,use_quota=True,user_id='dd87a332bb2a457caa2943d4e273bd1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Creating volume 1e8cacca-731e-4aa7-a41f-96a266df419c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:58 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db2fb82-3af1-4e48-be51-362f0eed148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-607511e2-2709-4c09-8bea-d038174991f3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3192ee4-b282-4aa2-a57d-3d05b88507e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:58 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c 1073741824 Nov 05 22:24:58 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume volume-607511e2-2709-4c09-8bea-d038174991f3 (607511e2-2709-4c09-8bea-d038174991f3): created successfully Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3192ee4-b282-4aa2-a57d-3d05b88507e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (06a6f623-248f-46fe-bc0c-0193148bfab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-74981bed-cda9-4c4c-9245-c90c7e5ee3b5 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created volume successfully. Nov 05 22:24:58 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c 1073741824" returned: 0 in 0.591s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:58 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c Nov 05 22:24:58 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:58 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4339889e-bb69-453a-9201-c91ffe783be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e8cacca-731e-4aa7-a41f-96a266df419c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c8416e-2189-40b9-9a41-6b328063e6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Volume volume-1e8cacca-731e-4aa7-a41f-96a266df419c (1e8cacca-731e-4aa7-a41f-96a266df419c): created successfully Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c8416e-2189-40b9-9a41-6b328063e6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Flow 'volume_create_manager' (00a004fe-0e2f-4136-ae96-1a14ad61e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3491055e-dd4b-47ec-8772-a92e7fa0cc7d tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created volume successfully. Nov 05 22:24:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-1e8cacca-731e-4aa7-a41f-96a266df419c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-1e8cacca-731e-4aa7-a41f-96a266df419c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-quobyte-1e8cacca-731e-4aa7-a41f-96a266df419c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-1e8cacca-731e-4aa7-a41f-96a266df419c" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb577fca-8c0d-4ebf-b545-b62f1a2f002b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:00 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c Nov 05 22:25:00 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:00 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c" returned: 0 in 0.417s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:00 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c Nov 05 22:25:00 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Flow 'volume_create_manager' (48aea5f7-f245-48f9-afd3-859bec8db839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59317236-0372-4897-8208-4ec11e9a026f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:00 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59317236-0372-4897-8208-4ec11e9a026f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-744377797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ab85fa-dfc4-44e4-b698-f142791d3c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47e9904125c4c5b902c382afa5d005b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:01Z,use_quota=True,user_id='b54ba45f587249558cf38050cb6da8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cef3e484-d02e-46cc-85f3-9b11edd3ed97),volume_type_id=cef3e484-d02e-46cc-85f3-9b11edd3ed97)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4a836c-f012-45f7-8d0d-1c6ba0c6c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4a836c-f012-45f7-8d0d-1c6ba0c6c784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d350e3-f8f3-4cfc-8675-3cc2a266866a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d350e3-f8f3-4cfc-8675-3cc2a266866a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ab85fa-dfc4-44e4-b698-f142791d3c31', 'volume_name': 'volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edee3b45-40ff-4cb3-a7c6-d7d4f0b38178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edee3b45-40ff-4cb3-a7c6-d7d4f0b38178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2253293-15d9-4a77-8433-202e1b81e397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:00 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Volume b5ab85fa-dfc4-44e4-b698-f142791d3c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31', 'volume_size': 1} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-744377797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ab85fa-dfc4-44e4-b698-f142791d3c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47e9904125c4c5b902c382afa5d005b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:01Z,use_quota=True,user_id='b54ba45f587249558cf38050cb6da8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cef3e484-d02e-46cc-85f3-9b11edd3ed97),volume_type_id=cef3e484-d02e-46cc-85f3-9b11edd3ed97)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Creating volume b5ab85fa-dfc4-44e4-b698-f142791d3c31 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:00 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1e8cacca-731e-4aa7-a41f-96a266df419c" returned: 0 in 0.404s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-1e8cacca-731e-4aa7-a41f-96a266df419c" released by "delete_volume" :: held 0.901s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:00 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31 1073741824 Nov 05 22:25:00 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created reservations ['c36efe06-79b2-4257-aa30-5dcdc89b5082', 'e78edc50-1e64-4f48-a9a1-dc61f8a86bb5', '36cc5b60-fd27-4c65-8c96-890dc4b7540f', 'a8761e40-6bff-4b2b-bc34-ec0cf26bf7f6'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:01 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:25:01 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Flow 'volume_create_manager' (c11d904f-9a3f-4447-bc5a-1f5bafc8f274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ac7f78-45dd-44c1-9fec-75c6df11125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ac7f78-45dd-44c1-9fec-75c6df11125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1576473431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de903ba2-d62a-4a53-8101-8d3d2a62f36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47e9904125c4c5b902c382afa5d005b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:01Z,use_quota=True,user_id='b54ba45f587249558cf38050cb6da8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0504e27-00d2-488d-b57c-dbe40676150c),volume_type_id=a0504e27-00d2-488d-b57c-dbe40676150c)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e97725-a8b3-4a91-9db9-40e5438c3e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e97725-a8b3-4a91-9db9-40e5438c3e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6c499f-7ef6-43e4-a103-dec7165dd219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6c499f-7ef6-43e4-a103-dec7165dd219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de903ba2-d62a-4a53-8101-8d3d2a62f36a', 'volume_name': 'volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f1c7f3-1a1f-492b-897d-d16b98f3ef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f1c7f3-1a1f-492b-897d-d16b98f3ef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f89b9c-b10c-4d52-a9f4-a9b8d66c2c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Volume de903ba2-d62a-4a53-8101-8d3d2a62f36a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a', 'volume_size': 1} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:01 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Deleted volume successfully. Nov 05 22:25:01 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31 1073741824" returned: 0 in 0.680s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0a20c7c5-f6fa-4dc1-9552-a75f2bc73ba8 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-1e8cacca-731e-4aa7-a41f-96a266df419c-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:01 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31 Nov 05 22:25:01 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:01 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-6d51abca-93f4-4ee6-b895-93cbab3a8f37 req-283ad9c1-f2c5-4366-beb6-ed3e767304b5 tempest-AttachVolumeNegativeTest-1784142477 None] Terminate volume connection completed successfully. Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-6d51abca-93f4-4ee6-b895-93cbab3a8f37 req-283ad9c1-f2c5-4366-beb6-ed3e767304b5 tempest-AttachVolumeNegativeTest-1784142477 None] Deleting attachment 0275415a-97fa-41ee-b77e-26f8df4d32f7. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:25:01 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31" returned: 0 in 0.467s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1576473431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de903ba2-d62a-4a53-8101-8d3d2a62f36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47e9904125c4c5b902c382afa5d005b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:01Z,use_quota=True,user_id='b54ba45f587249558cf38050cb6da8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0504e27-00d2-488d-b57c-dbe40676150c),volume_type_id=a0504e27-00d2-488d-b57c-dbe40676150c)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Creating volume de903ba2-d62a-4a53-8101-8d3d2a62f36a {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:01 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2253293-15d9-4a77-8433-202e1b81e397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:01 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a 1073741824 Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45070cd-4d85-4f25-95e9-33621ac65f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:01 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Volume volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31 (b5ab85fa-dfc4-44e4-b698-f142791d3c31): created successfully Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a45070cd-4d85-4f25-95e9-33621ac65f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Flow 'volume_create_manager' (48aea5f7-f245-48f9-afd3-859bec8db839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-74da45dd-0963-49a2-bcca-c1cd53000609 tempest-TestInstancesWithCinderVolumes-933327159 None] Created volume successfully. Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Flow 'volume_create_manager' (1f190c20-de22-4a38-900b-c83fe8ad7cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e99969e-7f18-4dfa-85a7-e69224a34c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-607511e2-2709-4c09-8bea-d038174991f3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e99969e-7f18-4dfa-85a7-e69224a34c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1493732522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8adbada-127d-4c51-9bc9-e81afd38aba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47e9904125c4c5b902c382afa5d005b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:02Z,use_quota=True,user_id='b54ba45f587249558cf38050cb6da8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08d7d15a-898d-46de-b74a-65f7ec7e92e8),volume_type_id=08d7d15a-898d-46de-b74a-65f7ec7e92e8)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184384bf-856e-41e7-93fe-5a1c1accd15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184384bf-856e-41e7-93fe-5a1c1accd15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800ead0c-d15f-4b58-be3d-d1d04501d093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-607511e2-2709-4c09-8bea-d038174991f3-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-quobyte-607511e2-2709-4c09-8bea-d038174991f3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-607511e2-2709-4c09-8bea-d038174991f3" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b2b52a-8d92-404a-8c54-260d79b03021]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:02 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3 Nov 05 22:25:02 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:02 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a 1073741824" returned: 0 in 0.627s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800ead0c-d15f-4b58-be3d-d1d04501d093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8adbada-127d-4c51-9bc9-e81afd38aba4', 'volume_name': 'volume-d8adbada-127d-4c51-9bc9-e81afd38aba4', 'volume_size': 1, 'image_id': 'c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--520689958', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd47e9904125c4c5b902c382afa5d005b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'created_at': datetime.datetime(2026, 11, 5, 21, 24, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5c67013-c8fc-47fb-94ba-5dc02d60548d/file', 'properties': {}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ff0fa3-7172-4291-b3fd-3ee059dcc9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:02 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a Nov 05 22:25:02 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ff0fa3-7172-4291-b3fd-3ee059dcc9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc570909-0548-4233-a381-eb4cf35dc9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Volume d8adbada-127d-4c51-9bc9-e81afd38aba4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8adbada-127d-4c51-9bc9-e81afd38aba4', 'volume_size': 1, 'image_id': 'c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--520689958', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd47e9904125c4c5b902c382afa5d005b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'created_at': datetime.datetime(2026, 11, 5, 21, 24, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5c67013-c8fc-47fb-94ba-5dc02d60548d/file', 'properties': {}}, 'image_service': } Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Trying to clone d8adbada-127d-4c51-9bc9-e81afd38aba4 from image c5c67013-c8fc-47fb-94ba-5dc02d60548d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:25:02 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3" returned: 0 in 0.533s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:02 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3 Nov 05 22:25:02 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:02 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f89b9c-b10c-4d52-a9f4-a9b8d66c2c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca59827-7cd7-404f-87af-6ca8f96f5ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Volume volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a (de903ba2-d62a-4a53-8101-8d3d2a62f36a): created successfully Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca59827-7cd7-404f-87af-6ca8f96f5ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Flow 'volume_create_manager' (c11d904f-9a3f-4447-bc5a-1f5bafc8f274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e616d9ac-6204-4874-a198-a1b55e5efc43 tempest-TestInstancesWithCinderVolumes-933327159 None] Created volume successfully. Nov 05 22:25:03 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-607511e2-2709-4c09-8bea-d038174991f3" returned: 0 in 0.529s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-607511e2-2709-4c09-8bea-d038174991f3" released by "delete_volume" :: held 1.132s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created reservations ['c9bde6ec-36b1-4c58-8ff2-07838bb01eca', 'b1b6318e-64cd-4ac3-aa41-6d3c44de9676', 'a075b5f1-2ab6-4feb-9555-608d435434ca', '9e9ece5e-24a4-4ca2-878b-f1d29f80b8d7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:03 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:25:03 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:03 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Deleted volume successfully. Nov 05 22:25:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cae3b2c8-dd7c-4c40-bf65-17f297ec04af tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-607511e2-2709-4c09-8bea-d038174991f3-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-20eeb2af-2102-41b6-89f2-5581098d2f8b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-20eeb2af-2102-41b6-89f2-5581098d2f8b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-quobyte-20eeb2af-2102-41b6-89f2-5581098d2f8b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-20eeb2af-2102-41b6-89f2-5581098d2f8b" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:04 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0926dca9-9481-4389-9250-6b3125e8108e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:04 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b Nov 05 22:25:04 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:04 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b" returned: 0 in 0.418s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:05 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b Nov 05 22:25:05 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:05 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-20eeb2af-2102-41b6-89f2-5581098d2f8b" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-20eeb2af-2102-41b6-89f2-5581098d2f8b" released by "delete_volume" :: held 0.749s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created reservations ['ebe6acb9-8363-4afd-8bbd-b9e545898cf3', 'de1d7171-6012-4b95-b3c0-4d33c882c63f', '11531854-8a58-4200-a46c-7897e1f8d459', 'ba2f2723-430f-4ddd-a4de-242f5dc5eee7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:05 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:25:05 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-735ffa3c-3096-47d6-8335-84adb01431b0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-735ffa3c-3096-47d6-8335-84adb01431b0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-quobyte-735ffa3c-3096-47d6-8335-84adb01431b0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-735ffa3c-3096-47d6-8335-84adb01431b0" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:05 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.343s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Deleted volume successfully. Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[549dead9-85f8-4d80-a20b-96a561a5576a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d6328480-d9bc-4280-9756-d8435efbfa97 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-20eeb2af-2102-41b6-89f2-5581098d2f8b-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:05 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0 Nov 05 22:25:05 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:06 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0" returned: 0 in 0.393s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:06 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0 Nov 05 22:25:06 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:06 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-735ffa3c-3096-47d6-8335-84adb01431b0" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-735ffa3c-3096-47d6-8335-84adb01431b0" released by "delete_volume" :: held 0.737s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created reservations ['06d784ad-a8c3-44a4-8574-bc382b7f44e3', '4bf05f0f-2df5-4e89-a0cc-633bb9889cf2', 'c82e9353-5394-4d41-bb18-7823602decf2', '6d6db992-45b1-464f-816c-28b12e7d0709'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:06 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:25:06 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-39658d88-bac5-4595-944b-ffd0b5030ac9-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-39658d88-bac5-4595-944b-ffd0b5030ac9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-quobyte-39658d88-bac5-4595-944b-ffd0b5030ac9" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-39658d88-bac5-4595-944b-ffd0b5030ac9" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:06 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Deleted volume successfully. Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e0a1dd-dc05-44f4-b832-4801f52d8e23]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bac748c1-3a2c-45c7-af85-f4c8e1a14717 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-735ffa3c-3096-47d6-8335-84adb01431b0-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:07 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9 Nov 05 22:25:07 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:07 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9" returned: 0 in 0.438s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:07 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9 Nov 05 22:25:07 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD, size 20.69 MB, duration 4.79 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:25:07 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Image download 20.69 MB at 4.32 MB/s Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b370ceea-48f2-4e12-8697-2492453c5095]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:07 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD Nov 05 22:25:07 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:07 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-39658d88-bac5-4595-944b-ffd0b5030ac9" returned: 0 in 0.306s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-39658d88-bac5-4595-944b-ffd0b5030ac9" released by "delete_volume" :: held 0.804s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created reservations ['2e320d1e-2fd0-4162-975f-6c84bf52ee33', 'c27fec71-d182-40bc-a40f-8d0da4ab07c8', 'd70a147c-9167-4914-8aaf-614871b5982b', '20d9eb25-4058-4b47-bddd-a003487c9156'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:07 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Temporary image c5c67013-c8fc-47fb-94ba-5dc02d60548d is fetched for user b54ba45f587249558cf38050cb6da8dc. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:07 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:25:07 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b586fc-89c1-4ff3-ac6b-ec7ce47a2d09]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-0000c48d-17d1-4ebc-a3ec-bdd62f416209-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-0000c48d-17d1-4ebc-a3ec-bdd62f416209-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "cinder-quobyte-0000c48d-17d1-4ebc-a3ec-bdd62f416209" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:08 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD Nov 05 22:25:08 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-0000c48d-17d1-4ebc-a3ec-bdd62f416209" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70c0705-790b-4154-8cd1-caa20c4846b6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:08 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.342s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Deleted volume successfully. Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a1409b94-2dbc-487f-9c71-dbb86ff7a092 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-39658d88-bac5-4595-944b-ffd0b5030ac9-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:08 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209 Nov 05 22:25:08 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:08 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1493732522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8adbada-127d-4c51-9bc9-e81afd38aba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47e9904125c4c5b902c382afa5d005b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:02Z,use_quota=True,user_id='b54ba45f587249558cf38050cb6da8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08d7d15a-898d-46de-b74a-65f7ec7e92e8),volume_type_id=08d7d15a-898d-46de-b74a-65f7ec7e92e8)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Creating volume d8adbada-127d-4c51-9bc9-e81afd38aba4 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:08 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:08 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 1073741824 Nov 05 22:25:08 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:08 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209" returned: 0 in 0.445s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:08 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209 Nov 05 22:25:08 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:08 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 1073741824" returned: 0 in 0.507s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:08 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0000c48d-17d1-4ebc-a3ec-bdd62f416209" returned: 0 in 0.292s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-quobyte-0000c48d-17d1-4ebc-a3ec-bdd62f416209" released by "delete_volume" :: held 0.790s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:08 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 Nov 05 22:25:08 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:08 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Created reservations ['0382c68d-193d-44a1-ac6d-98eb6b919f44', '49cbb0f7-3eb7-4eb3-9535-b022199ffa34', '755d3903-f936-4027-baca-a5cb1e52afaf', '77e26b1b-b326-4109-b0e7-4c8f89056b14'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:09 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:25:09 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:09 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Attempting download of c5c67013-c8fc-47fb-94ba-5dc02d60548d ((None, [{'url': 'file:///opt/stack/data/glance/images/c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'metadata': {}}])) to volume d8adbada-127d-4c51-9bc9-e81afd38aba4. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c42c83-472a-44cb-b74f-95cad40417d4]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5c67013-c8fc-47fb-94ba-5dc02d60548d_f9oi8232 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:09 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Deleted volume successfully. Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2ed5fc4c-08d3-45c3-b64b-4887913a0387 tempest-CreateVolumesFromSourceVolumeTest-1659424052 None] Lock "cinder-0000c48d-17d1-4ebc-a3ec-bdd62f416209-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:09 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5c67013-c8fc-47fb-94ba-5dc02d60548d_f9oi8232 Nov 05 22:25:09 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:09 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5c67013-c8fc-47fb-94ba-5dc02d60548d_f9oi8232" returned: 0 in 0.405s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5c67013-c8fc-47fb-94ba-5dc02d60548d_f9oi8232 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:09 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5c67013-c8fc-47fb-94ba-5dc02d60548d_f9oi8232 Nov 05 22:25:09 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:10 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5c67013-c8fc-47fb-94ba-5dc02d60548d_f9oi8232" returned: 1 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5c67013-c8fc-47fb-94ba-5dc02d60548d_f9oi8232' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:25:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f23ff8-b956-4fc3-9fb6-fcbe72f18c3c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:10 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD Nov 05 22:25:10 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:10 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:10 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] c5c67013-c8fc-47fb-94ba-5dc02d60548d was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:25:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:10 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 Nov 05 22:25:10 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:13 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Flow 'volume_create_manager' (c3bbe8ff-1e15-4926-bcad-271ac27a4d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5ea0b9-120b-46a9-9f05-d2808e388935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4" returned: 0 in 2.468s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5c67013-c8fc-47fb-94ba-5dc02d60548d_1de4th42devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:25:13 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Converted 112.00 MB image at 45.38 MB/s Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5ea0b9-120b-46a9-9f05-d2808e388935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72382ab-99e5-4f32-b430-0e5118cd9cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995fd73142794964bcdaf4afc48b149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:13Z,use_quota=True,user_id='f54f376ee72546bbad0e403137bb6374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3176b16-49bc-4d40-985b-3661720ce32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:13 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 1G Nov 05 22:25:13 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3176b16-49bc-4d40-985b-3661720ce32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73100d8-1e6f-4ca6-9583-6488b4cbd7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73100d8-1e6f-4ca6-9583-6488b4cbd7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72382ab-99e5-4f32-b430-0e5118cd9cd3', 'volume_name': 'volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a945f04f-e780-4f8b-a0a9-63d69ee072a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a945f04f-e780-4f8b-a0a9-63d69ee072a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe51e318-3a43-49c0-9bf9-0a325bef1d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Volume e72382ab-99e5-4f32-b430-0e5118cd9cd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3', 'volume_size': 1} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72382ab-99e5-4f32-b430-0e5118cd9cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995fd73142794964bcdaf4afc48b149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:13Z,use_quota=True,user_id='f54f376ee72546bbad0e403137bb6374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Creating volume e72382ab-99e5-4f32-b430-0e5118cd9cd3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:13 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:13 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3 1073741824 Nov 05 22:25:13 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:13 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 1G" returned: 0 in 0.444s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Downloaded image c5c67013-c8fc-47fb-94ba-5dc02d60548d ((None, [{'url': 'file:///opt/stack/data/glance/images/c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'metadata': {}}])) to volume d8adbada-127d-4c51-9bc9-e81afd38aba4 successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Temporary image c5c67013-c8fc-47fb-94ba-5dc02d60548d for user b54ba45f587249558cf38050cb6da8dc is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Marking volume d8adbada-127d-4c51-9bc9-e81afd38aba4 as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Copying metadata from image c5c67013-c8fc-47fb-94ba-5dc02d60548d to d8adbada-127d-4c51-9bc9-e81afd38aba4. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Creating volume glance metadata for volume d8adbada-127d-4c51-9bc9-e81afd38aba4 backed by image c5c67013-c8fc-47fb-94ba-5dc02d60548d with: {'image_id': 'c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'image_name': 'tempest-scenario-img--520689958', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc570909-0548-4233-a381-eb4cf35dc9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8adbada-127d-4c51-9bc9-e81afd38aba4', 'volume_size': 1, 'image_id': 'c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--520689958', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd47e9904125c4c5b902c382afa5d005b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5c67013-c8fc-47fb-94ba-5dc02d60548d', 'created_at': datetime.datetime(2026, 11, 5, 21, 24, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5c67013-c8fc-47fb-94ba-5dc02d60548d/file', 'properties': {}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1decff3c-cb25-4a4c-8ef6-fe3074607ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:13 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Volume volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 (d8adbada-127d-4c51-9bc9-e81afd38aba4): created successfully Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1decff3c-cb25-4a4c-8ef6-fe3074607ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Flow 'volume_create_manager' (1f190c20-de22-4a38-900b-c83fe8ad7cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3d197c58-4103-499c-8f42-3be148ab6a3c tempest-TestInstancesWithCinderVolumes-933327159 None] Created volume successfully. Nov 05 22:25:13 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3 1073741824" returned: 0 in 0.560s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:13 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3 Nov 05 22:25:13 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:14 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3" returned: 0 in 0.373s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe51e318-3a43-49c0-9bf9-0a325bef1d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdec04f5-91d1-4b3f-a962-726145ab8ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Volume volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3 (e72382ab-99e5-4f32-b430-0e5118cd9cd3): created successfully Nov 05 22:25:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdec04f5-91d1-4b3f-a962-726145ab8ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Flow 'volume_create_manager' (c3bbe8ff-1e15-4926-bcad-271ac27a4d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6b69e0a0-4570-4b99-b57f-aefa1e7440e4 tempest-CinderUnicodeTest-1150819514 None] Created volume successfully. Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Flow 'volume_create_manager' (69a583a2-ebbc-41f1-b0d9-481c66bd3a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497deca7-eced-432b-b447-aaf3f67d4720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497deca7-eced-432b-b447-aaf3f67d4720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-930105380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95ed562-3812-47b3-a644-1aae22dc0823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995fd73142794964bcdaf4afc48b149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:16Z,use_quota=True,user_id='f54f376ee72546bbad0e403137bb6374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca995136-a504-4fc0-af03-81cb79630088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca995136-a504-4fc0-af03-81cb79630088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd81321-5d98-479e-9c2f-9b64b1499e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd81321-5d98-479e-9c2f-9b64b1499e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95ed562-3812-47b3-a644-1aae22dc0823', 'volume_name': 'volume-e95ed562-3812-47b3-a644-1aae22dc0823', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e4ee89-b2e2-488c-aeea-ac179f9f1db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e4ee89-b2e2-488c-aeea-ac179f9f1db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40aeba07-a55f-4a1f-8d7e-c18a5ec3e42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Volume e95ed562-3812-47b3-a644-1aae22dc0823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95ed562-3812-47b3-a644-1aae22dc0823', 'volume_size': 1} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-930105380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95ed562-3812-47b3-a644-1aae22dc0823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='995fd73142794964bcdaf4afc48b149d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:16Z,use_quota=True,user_id='f54f376ee72546bbad0e403137bb6374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Creating volume e95ed562-3812-47b3-a644-1aae22dc0823 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:16 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:25:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:16 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 1073741824 Nov 05 22:25:16 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:17 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 1073741824" returned: 0 in 0.898s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:17 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 Nov 05 22:25:17 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:17 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823" returned: 0 in 0.441s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40aeba07-a55f-4a1f-8d7e-c18a5ec3e42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95ed562-3812-47b3-a644-1aae22dc0823', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acfff37-b92b-48ff-b885-83e6cc3372c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Volume volume-e95ed562-3812-47b3-a644-1aae22dc0823 (e95ed562-3812-47b3-a644-1aae22dc0823): created successfully Nov 05 22:25:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2acfff37-b92b-48ff-b885-83e6cc3372c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Flow 'volume_create_manager' (69a583a2-ebbc-41f1-b0d9-481c66bd3a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-28e50baa-4905-4d62-ae94-b532f274bcb9 tempest-CinderUnicodeTest-1150819514 None] Created volume successfully. Nov 05 22:25:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-fd898782-4753-49d4-bcdc-dfa5101eb20e req-36023f16-62b1-4d7d-aa51-91b7fa22403b tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-fd898782-4753-49d4-bcdc-dfa5101eb20e req-36023f16-62b1-4d7d-aa51-91b7fa22403b tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-fd898782-4753-49d4-bcdc-dfa5101eb20e req-36023f16-62b1-4d7d-aa51-91b7fa22403b tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-fd898782-4753-49d4-bcdc-dfa5101eb20e req-36023f16-62b1-4d7d-aa51-91b7fa22403b tempest-TestInstancesWithCinderVolumes-933327159 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-d8adbada-127d-4c51-9bc9-e81afd38aba4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1986268a-0744-4f15-9ce0-03051356fff1', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:25:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-fd898782-4753-49d4-bcdc-dfa5101eb20e req-36023f16-62b1-4d7d-aa51-91b7fa22403b tempest-TestInstancesWithCinderVolumes-933327159 None] attachment_update completed successfully. Nov 05 22:25:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Creating offline snapshot 0a843fbd-9607-4a43-a47b-e64b78e9ba9d of volume e95ed562-3812-47b3-a644-1aae22dc0823 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:25:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e1420f-9641-4104-bc88-ea3bce373bce]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:19 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 Nov 05 22:25:19 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:19 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823" returned: 0 in 0.761s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:19 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d 1G Nov 05 22:25:19 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:20 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d 1G" returned: 0 in 0.516s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e95ed562-3812-47b3-a644-1aae22dc0823 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:20 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e95ed562-3812-47b3-a644-1aae22dc0823 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d Nov 05 22:25:20 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:20 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e95ed562-3812-47b3-a644-1aae22dc0823 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:20 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d is being set with open permissions: ugo+rw Nov 05 22:25:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:20 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d Nov 05 22:25:20 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:20 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:21 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.info Nov 05 22:25:21 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:21 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.info" returned: 0 in 0.320s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:21 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.info is being set with open permissions: ugo+rw Nov 05 22:25:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:21 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.info Nov 05 22:25:21 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:21 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.info" returned: 0 in 0.679s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.191s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b72e0b13-8b2d-4c05-847d-1844ba8e5f82 tempest-CinderUnicodeTest-1150819514 None] Create snapshot completed successfully Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "cinder-0a843fbd-9607-4a43-a47b-e64b78e9ba9d-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-0a843fbd-9607-4a43-a47b-e64b78e9ba9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "cinder-quobyte-e95ed562-3812-47b3-a644-1aae22dc0823" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-quobyte-e95ed562-3812-47b3-a644-1aae22dc0823" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "cinder-quobyte-0a843fbd-9607-4a43-a47b-e64b78e9ba9d" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-quobyte-0a843fbd-9607-4a43-a47b-e64b78e9ba9d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Deleting offline snapshot 0a843fbd-9607-4a43-a47b-e64b78e9ba9d of volume e95ed562-3812-47b3-a644-1aae22dc0823 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] snapshot_file for this snap is: volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4648948-90d0-4439-857d-604bfd69e21b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:23 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d Nov 05 22:25:23 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:23 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e95ed562-3812-47b3-a644-1aae22dc0823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49bc3a2-9a0f-4c7b-bffb-887c522f4f2c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:23 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 Nov 05 22:25:23 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:24 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823" returned: 0 in 0.460s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:24 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d Nov 05 22:25:24 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:24 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d" returned: 0 in 0.357s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:24 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d Nov 05 22:25:24 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:24 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823.0a843fbd-9607-4a43-a47b-e64b78e9ba9d" returned: 0 in 0.303s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-quobyte-0a843fbd-9607-4a43-a47b-e64b78e9ba9d" released by "_delete_snapshot" :: held 1.692s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-quobyte-e95ed562-3812-47b3-a644-1aae22dc0823" released by "delete_snapshot" :: held 1.716s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:25 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Created reservations ['20a6ebe6-d109-49ec-a827-849a07064ca1', 'ec6e8e9a-b420-47a2-bacc-76c3df9ad53a', '79e924ff-ef76-49f7-b657-8a665d244bcd', '240018ef-451a-434c-9f81-c9863fab96d2'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Delete snapshot completed successfully. Nov 05 22:25:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-423f5b10-6613-4e4a-97f3-ba29375065f8 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-0a843fbd-9607-4a43-a47b-e64b78e9ba9d-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "cinder-e95ed562-3812-47b3-a644-1aae22dc0823-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-e95ed562-3812-47b3-a644-1aae22dc0823-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "cinder-quobyte-e95ed562-3812-47b3-a644-1aae22dc0823" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-quobyte-e95ed562-3812-47b3-a644-1aae22dc0823" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[647900e7-0da6-4597-af1a-7e8a3ecb22ff]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:25 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 Nov 05 22:25:25 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:26 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823" returned: 0 in 0.532s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:26 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823 Nov 05 22:25:26 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:26 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e95ed562-3812-47b3-a644-1aae22dc0823" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-quobyte-e95ed562-3812-47b3-a644-1aae22dc0823" released by "delete_volume" :: held 0.906s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Created reservations ['9724468e-5c70-4c66-9c06-a213ed256735', '1c836dfb-b0b9-40a7-b113-28d54054f9e4', '10749495-aa39-4928-b833-56ee883dca19', '0df35956-affe-4a00-a66c-d80b5925a641'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "cinder-e72382ab-99e5-4f32-b430-0e5118cd9cd3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:26 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:25:26 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-e72382ab-99e5-4f32-b430-0e5118cd9cd3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "cinder-quobyte-e72382ab-99e5-4f32-b430-0e5118cd9cd3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-quobyte-e72382ab-99e5-4f32-b430-0e5118cd9cd3" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9913027c-b2d5-4701-9346-61e7e94ccaca]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:27 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3 Nov 05 22:25:27 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:27 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.576s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:27 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Deleted volume successfully. Nov 05 22:25:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2104a091-cde6-428e-a3d1-91b30bff4bf6 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-e95ed562-3812-47b3-a644-1aae22dc0823-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:27 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3" returned: 0 in 0.625s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:27 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3 Nov 05 22:25:27 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:28 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e72382ab-99e5-4f32-b430-0e5118cd9cd3" returned: 0 in 0.435s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-quobyte-e72382ab-99e5-4f32-b430-0e5118cd9cd3" released by "delete_volume" :: held 1.140s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Created reservations ['f8028781-8f9a-4d92-89de-05355445a94b', '96ff49b7-3823-4953-9121-5dd37c11db27', 'ce3dd19d-bac4-4165-8e42-e6ec14469e1c', 'a5a8f585-307b-45d9-84ff-7a0c2ee0baf9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:28 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:25:28 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:28 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.416s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Deleted volume successfully. Nov 05 22:25:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-28f82c75-3743-4f77-a09a-8318c8dcd867 tempest-CinderUnicodeTest-1150819514 None] Lock "cinder-e72382ab-99e5-4f32-b430-0e5118cd9cd3-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:38 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=73,cinder:UPDATE=110,cinder:DELETE=12,cinder:INSERT=27 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:25:38 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=103,cinder:INSERT=30,cinder:SELECT=94,cinder:DELETE=8 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Flow 'volume_create_manager' (31e0e8ec-156a-4aeb-9d4e-8376c9a184a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e626d835-a62d-48fe-94d7-5d9b77480b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e626d835-a62d-48fe-94d7-5d9b77480b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1831526766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42def13c-b26b-4e6d-b059-bececa50ccb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a105a01daeb8457ab70a2adbb25789e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:39Z,use_quota=True,user_id='1257470090d34a63aa80b428a5f66ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288ab4f4-d648-46db-bbb1-7ea337ced4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288ab4f4-d648-46db-bbb1-7ea337ced4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335f1450-eccc-4a8b-9231-0b4a391d8174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335f1450-eccc-4a8b-9231-0b4a391d8174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42def13c-b26b-4e6d-b059-bececa50ccb3', 'volume_name': 'volume-42def13c-b26b-4e6d-b059-bececa50ccb3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a766f1af-3e3c-4936-bc9c-ac0e9288471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a766f1af-3e3c-4936-bc9c-ac0e9288471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecab15f-47f7-4a09-98f9-213eee65160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Volume 42def13c-b26b-4e6d-b059-bececa50ccb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42def13c-b26b-4e6d-b059-bececa50ccb3', 'volume_size': 1} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1831526766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42def13c-b26b-4e6d-b059-bececa50ccb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a105a01daeb8457ab70a2adbb25789e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:39Z,use_quota=True,user_id='1257470090d34a63aa80b428a5f66ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Creating volume 42def13c-b26b-4e6d-b059-bececa50ccb3 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:25:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:39 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3 1073741824 Nov 05 22:25:39 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:40 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3 1073741824" returned: 0 in 0.618s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:40 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3 Nov 05 22:25:40 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:40 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3" returned: 0 in 0.335s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecab15f-47f7-4a09-98f9-213eee65160a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42def13c-b26b-4e6d-b059-bececa50ccb3', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062fe095-7378-49be-8195-6f3424b8ce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Volume volume-42def13c-b26b-4e6d-b059-bececa50ccb3 (42def13c-b26b-4e6d-b059-bececa50ccb3): created successfully Nov 05 22:25:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062fe095-7378-49be-8195-6f3424b8ce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Flow 'volume_create_manager' (31e0e8ec-156a-4aeb-9d4e-8376c9a184a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3a12a299-ec8e-4e27-a220-ba22193be583 tempest-AttachVolumeNegativeTest-1784142477 None] Created volume successfully. Nov 05 22:25:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-8421165b-e482-4361-af79-977b09ffac18 req-acafbf5a-a9e3-4155-802a-c3c936f363ac tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-8421165b-e482-4361-af79-977b09ffac18 req-acafbf5a-a9e3-4155-802a-c3c936f363ac tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-8421165b-e482-4361-af79-977b09ffac18 req-acafbf5a-a9e3-4155-802a-c3c936f363ac tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-8421165b-e482-4361-af79-977b09ffac18 req-acafbf5a-a9e3-4155-802a-c3c936f363ac tempest-AttachVolumeNegativeTest-1784142477 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-42def13c-b26b-4e6d-b059-bececa50ccb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68a068cb-f9d1-4cc3-b0ab-ef92ce64c43a', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:25:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-8421165b-e482-4361-af79-977b09ffac18 req-acafbf5a-a9e3-4155-802a-c3c936f363ac tempest-AttachVolumeNegativeTest-1784142477 None] attachment_update completed successfully. Nov 05 22:25:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-2e367846-72f8-4b3d-98f0-9f513a39021d req-8bfb44f2-4623-46dd-aec7-a085cf05d360 tempest-AttachVolumeNegativeTest-1784142477 None] Terminate volume connection completed successfully. Nov 05 22:25:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-2e367846-72f8-4b3d-98f0-9f513a39021d req-8bfb44f2-4623-46dd-aec7-a085cf05d360 tempest-AttachVolumeNegativeTest-1784142477 None] Deleting attachment 68a068cb-f9d1-4cc3-b0ab-ef92ce64c43a. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Flow 'volume_create_manager' (b4e16425-4dde-4d38-a792-63eae85f2ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3277785-6b92-4a8f-9839-d0f07ee92342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3277785-6b92-4a8f-9839-d0f07ee92342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-702031808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f77f36c-7582-4407-b62e-685be80b5df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d612ad8fb0247d5991d65a59963409e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:53Z,use_quota=True,user_id='860cce99b6cc49708383467a1ac7aec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9b859a-07b4-4d21-b702-5dac293f89e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9b859a-07b4-4d21-b702-5dac293f89e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efcbe3e-5806-4fa1-b7ff-807c746b6826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6efcbe3e-5806-4fa1-b7ff-807c746b6826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f77f36c-7582-4407-b62e-685be80b5df0', 'volume_name': 'volume-7f77f36c-7582-4407-b62e-685be80b5df0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38712d4b-b346-4bea-acf0-3f2dd812b022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38712d4b-b346-4bea-acf0-3f2dd812b022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf20be82-023c-42d2-a23e-7146f9f24ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:53 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Volume 7f77f36c-7582-4407-b62e-685be80b5df0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f77f36c-7582-4407-b62e-685be80b5df0', 'volume_size': 1} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-702031808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f77f36c-7582-4407-b62e-685be80b5df0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d612ad8fb0247d5991d65a59963409e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:53Z,use_quota=True,user_id='860cce99b6cc49708383467a1ac7aec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Creating volume 7f77f36c-7582-4407-b62e-685be80b5df0 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:53 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:53 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 1073741824 Nov 05 22:25:53 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-8c4392f9-a052-422a-9e60-5422028a93df req-661a616d-4f2f-43c3-8a57-8a747142829b tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:54 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 1073741824" returned: 0 in 0.472s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:54 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 Nov 05 22:25:54 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:54 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-8c4392f9-a052-422a-9e60-5422028a93df req-661a616d-4f2f-43c3-8a57-8a747142829b tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.746s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf20be82-023c-42d2-a23e-7146f9f24ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f77f36c-7582-4407-b62e-685be80b5df0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3737ac7-7d34-4622-9546-84035dd77a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-8c4392f9-a052-422a-9e60-5422028a93df req-661a616d-4f2f-43c3-8a57-8a747142829b tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Volume volume-7f77f36c-7582-4407-b62e-685be80b5df0 (7f77f36c-7582-4407-b62e-685be80b5df0): created successfully Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3737ac7-7d34-4622-9546-84035dd77a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Flow 'volume_create_manager' (b4e16425-4dde-4d38-a792-63eae85f2ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-8c4392f9-a052-422a-9e60-5422028a93df req-661a616d-4f2f-43c3-8a57-8a747142829b tempest-TestInstancesWithCinderVolumes-933327159 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb6c73e1-135e-4bb2-aaba-7ee7f47da163', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:25:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c1d11322-0b77-4062-b9b9-ebc2a6ac976b tempest-SnapshotDependencyTests-702345106 None] Created volume successfully. Nov 05 22:25:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-8c4392f9-a052-422a-9e60-5422028a93df req-661a616d-4f2f-43c3-8a57-8a747142829b tempest-TestInstancesWithCinderVolumes-933327159 None] attachment_update completed successfully. Nov 05 22:25:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Creating offline snapshot 823009ac-72d3-4838-bab4-0174dab525a4 of volume 7f77f36c-7582-4407-b62e-685be80b5df0 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:25:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c695357f-8223-4321-b715-bca345b2fea1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:56 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 Nov 05 22:25:56 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:56 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0" returned: 0 in 0.432s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:56 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 1G Nov 05 22:25:56 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-bc557c15-264f-447c-a855-44302e7a6dc4 req-92fd26cb-3576-43b0-9712-78f20da8611a tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:57 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 1G" returned: 0 in 0.514s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f77f36c-7582-4407-b62e-685be80b5df0 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:57 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f77f36c-7582-4407-b62e-685be80b5df0 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 Nov 05 22:25:57 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:57 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f77f36c-7582-4407-b62e-685be80b5df0 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:57 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 is being set with open permissions: ugo+rw Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:57 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 Nov 05 22:25:57 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:57 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:57 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:25:57 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:57 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.info Nov 05 22:25:57 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:57 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:58 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:25:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:25:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:25:58 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.info" returned: 0 in 0.468s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:58 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.info is being set with open permissions: ugo+rw Nov 05 22:25:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:58 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.info Nov 05 22:25:58 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:58 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.info" returned: 0 in 0.328s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-bc557c15-264f-447c-a855-44302e7a6dc4 req-92fd26cb-3576-43b0-9712-78f20da8611a tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.588s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-bc557c15-264f-447c-a855-44302e7a6dc4 req-92fd26cb-3576-43b0-9712-78f20da8611a tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-310f295f-1046-4785-a811-3fa3e9c5ba49 tempest-SnapshotDependencyTests-702345106 None] Create snapshot completed successfully Nov 05 22:25:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-bc557c15-264f-447c-a855-44302e7a6dc4 req-92fd26cb-3576-43b0-9712-78f20da8611a tempest-TestInstancesWithCinderVolumes-933327159 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ceff9243-cd4d-4a56-bc80-60be581f5f5f', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:25:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-bc557c15-264f-447c-a855-44302e7a6dc4 req-92fd26cb-3576-43b0-9712-78f20da8611a tempest-TestInstancesWithCinderVolumes-933327159 None] attachment_update completed successfully. Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Flow 'volume_create_manager' (27889326-c92a-4841-9ad7-5aad704b1b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d93e244-6da0-406e-afad-a39fc39479a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d93e244-6da0-406e-afad-a39fc39479a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d612ad8fb0247d5991d65a59963409e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=823009ac-72d3-4838-bab4-0174dab525a4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:00Z,use_quota=True,user_id='860cce99b6cc49708383467a1ac7aec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75e7542-b6b3-4492-bfb8-7ffbd2cac24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75e7542-b6b3-4492-bfb8-7ffbd2cac24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1966a85d-5655-4f1e-84c2-417acddecc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1966a85d-5655-4f1e-84c2-417acddecc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0', 'volume_name': 'volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0', 'volume_size': 1, 'snapshot_id': '823009ac-72d3-4838-bab4-0174dab525a4'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523cf2e3-7aa9-4a81-8300-73f213f8bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523cf2e3-7aa9-4a81-8300-73f213f8bee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c690e23-ad4e-424f-a2f5-90b61ff74fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:00 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Volume 7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0', 'volume_size': 1, 'snapshot_id': '823009ac-72d3-4838-bab4-0174dab525a4'} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "cinder-quobyte-823009ac-72d3-4838-bab4-0174dab525a4-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-823009ac-72d3-4838-bab4-0174dab525a4-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Creating volume 7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 from snapshot 823009ac-72d3-4838-bab4-0174dab525a4 {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "cinder-quobyte-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] snapshot: 823009ac-72d3-4838-bab4-0174dab525a4, volume: 7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89f589d-bfab-4014-859d-73cfc5dd8b4c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:00 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 Nov 05 22:26:00 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:00 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f77f36c-7582-4407-b62e-685be80b5df0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f71946e-d3e7-4c78-a334-d42019bab190]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:00 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 Nov 05 22:26:00 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:01 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0" returned: 0 in 0.451s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:26:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:26:01 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:26:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:01 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 Nov 05 22:26:01 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-fbc8154b-dba9-416a-ab23-07ba2596a60a req-0640bbbb-4c25-4129-9246-06eb217d9484 tempest-TestInstancesWithCinderVolumes-933327159 None] Terminate volume connection completed successfully. Nov 05 22:26:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-fbc8154b-dba9-416a-ab23-07ba2596a60a req-0640bbbb-4c25-4129-9246-06eb217d9484 tempest-TestInstancesWithCinderVolumes-933327159 None] Deleting attachment eb6c73e1-135e-4bb2-aaba-7ee7f47da163. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:26:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "cinder-b5ab85fa-dfc4-44e4-b698-f142791d3c31-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-b5ab85fa-dfc4-44e4-b698-f142791d3c31-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "cinder-quobyte-b5ab85fa-dfc4-44e4-b698-f142791d3c31" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-quobyte-b5ab85fa-dfc4-44e4-b698-f142791d3c31" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae01ca18-eda0-4e13-a51b-0de244d6a56a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:08 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31 Nov 05 22:26:08 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:08 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31" returned: 0 in 0.746s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:08 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31 Nov 05 22:26:08 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:09 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b5ab85fa-dfc4-44e4-b698-f142791d3c31" returned: 0 in 0.622s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-quobyte-b5ab85fa-dfc4-44e4-b698-f142791d3c31" released by "delete_volume" :: held 1.510s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:09 devstack cinder-volume[87122]: WARNING cinder.quota [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1627816606-248434958 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1627816606-248434958, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:26:09 devstack cinder-volume[87122]: WARNING cinder.quota [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1627816606-248434958 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1627816606-248434958, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:26:09 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Created reservations ['61faae2d-8d33-4da9-8f59-d76578945e0b', '3978c0ac-6614-48c7-9a25-f7f26ecbb195', 'f0869155-a1c8-4874-a514-b607760efd5a', '1a428643-79dd-467d-8ebb-ee812d603e9a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:09 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:26:09 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:10 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.538s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:10 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Deleted volume successfully. Nov 05 22:26:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4605122-3942-4abd-9e9f-ff3d492fc101 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-b5ab85fa-dfc4-44e4-b698-f142791d3c31-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:10 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" returned: 0 in 9.430s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:10 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0, size 1024.00 MB, duration 9.43 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:26:10 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Converted 1024.00 MB image at 108.56 MB/s Nov 05 22:26:10 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 is being set with open permissions: ugo+rw Nov 05 22:26:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:10 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 Nov 05 22:26:10 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:10 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" released by "_copy_volume_from_snapshot" :: held 10.702s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-823009ac-72d3-4838-bab4-0174dab525a4-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" released by "_create_volume_from_snapshot" :: held 10.776s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.797s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c690e23-ad4e-424f-a2f5-90b61ff74fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0', 'volume_size': 1, 'snapshot_id': '823009ac-72d3-4838-bab4-0174dab525a4'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c0f3eb-5bea-43ac-9620-be693efb7a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:11 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Volume volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 (7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0): created successfully Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c0f3eb-5bea-43ac-9620-be693efb7a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Flow 'volume_create_manager' (27889326-c92a-4841-9ad7-5aad704b1b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b52ea8b7-b191-4d3d-85aa-82e5ee8f43fc tempest-SnapshotDependencyTests-702345106 None] Created volume successfully. Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "cinder-823009ac-72d3-4838-bab4-0174dab525a4-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-823009ac-72d3-4838-bab4-0174dab525a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "cinder-quobyte-7f77f36c-7582-4407-b62e-685be80b5df0" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-7f77f36c-7582-4407-b62e-685be80b5df0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "cinder-quobyte-823009ac-72d3-4838-bab4-0174dab525a4" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-823009ac-72d3-4838-bab4-0174dab525a4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Deleting offline snapshot 823009ac-72d3-4838-bab4-0174dab525a4 of volume 7f77f36c-7582-4407-b62e-685be80b5df0 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] snapshot_file for this snap is: volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f8f919-d8db-4db6-b1d7-f09a98fb95b3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:11 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 Nov 05 22:26:11 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:12 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4" returned: 0 in 0.417s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f77f36c-7582-4407-b62e-685be80b5df0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:26:12 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[538042d4-a247-4a40-89fa-cf350517ed7a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:12 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 Nov 05 22:26:12 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:12 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0" returned: 0 in 0.571s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:12 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 Nov 05 22:26:12 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:13 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:13 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4 Nov 05 22:26:13 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-5a7a450a-9cd0-4916-820a-36f92a904572 req-d4e5e236-3f29-4c70-b3cb-666cf7cc9afe tempest-TestInstancesWithCinderVolumes-933327159 None] Terminate volume connection completed successfully. Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-5a7a450a-9cd0-4916-820a-36f92a904572 req-d4e5e236-3f29-4c70-b3cb-666cf7cc9afe tempest-TestInstancesWithCinderVolumes-933327159 None] Deleting attachment ceff9243-cd4d-4a56-bc80-60be581f5f5f. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:26:13 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0.823009ac-72d3-4838-bab4-0174dab525a4" returned: 0 in 0.271s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-823009ac-72d3-4838-bab4-0174dab525a4" released by "_delete_snapshot" :: held 1.740s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-7f77f36c-7582-4407-b62e-685be80b5df0" released by "delete_snapshot" :: held 1.761s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Created reservations ['20deba53-5ee0-41b7-89c1-1546b480a7af', '086d1cd8-8235-48f6-b0de-9893df3f710a', 'c0a9f56c-f608-4a1c-b86b-66edcebfc1b9', '9c916fb6-d07c-432a-89e3-cf5fe71af97b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Delete snapshot completed successfully. Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1b15243e-a79d-4158-bc2d-44a804244db5 tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-823009ac-72d3-4838-bab4-0174dab525a4-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "cinder-7f77f36c-7582-4407-b62e-685be80b5df0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-7f77f36c-7582-4407-b62e-685be80b5df0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "cinder-quobyte-7f77f36c-7582-4407-b62e-685be80b5df0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-7f77f36c-7582-4407-b62e-685be80b5df0" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[635b22c6-36a5-4372-94ec-1eacabc5b1ae]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "cinder-de903ba2-d62a-4a53-8101-8d3d2a62f36a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-de903ba2-d62a-4a53-8101-8d3d2a62f36a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:13 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 Nov 05 22:26:13 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "cinder-quobyte-de903ba2-d62a-4a53-8101-8d3d2a62f36a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-quobyte-de903ba2-d62a-4a53-8101-8d3d2a62f36a" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f921601-68ea-4eea-94f8-b64c4de99739]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:14 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a Nov 05 22:26:14 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:14 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:14 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0 Nov 05 22:26:14 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:14 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a" returned: 0 in 0.435s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:14 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a Nov 05 22:26:14 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:14 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7f77f36c-7582-4407-b62e-685be80b5df0" returned: 0 in 0.289s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-7f77f36c-7582-4407-b62e-685be80b5df0" released by "delete_volume" :: held 0.791s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Created reservations ['165981e3-b483-4bf3-8c6b-2f0a5be8f6c7', '63a60425-e9b7-440a-a51c-37da8a3b8bdd', '845059df-0349-4d53-91fd-204931f15e12', '5cd355ef-4cd0-4b8a-a627-d3799039be39'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:14 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-de903ba2-d62a-4a53-8101-8d3d2a62f36a" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:14 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:26:14 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-quobyte-de903ba2-d62a-4a53-8101-8d3d2a62f36a" released by "delete_volume" :: held 0.761s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:14 devstack cinder-volume[87122]: WARNING cinder.quota [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115085180-618286719 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115085180-618286719, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:26:14 devstack cinder-volume[87122]: WARNING cinder.quota [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115085180-618286719 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115085180-618286719, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Created reservations ['98033855-b7d2-44ab-a115-000e7eeafa48', '9b5e700c-26cb-4bbb-bea4-de25f76d9a27', '9b9a0ef6-b90a-470b-bf1a-98f47dc56fba', '2a0f48d8-4285-429f-af29-60caf10645a3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "cinder-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:14 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:26:14 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "cinder-quobyte-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2457261b-d4f3-4a01-9752-3a2c5bbf4773]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:15 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.393s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Deleted volume successfully. Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e360fa18-7da2-4d44-9d52-d005611234ba tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-7f77f36c-7582-4407-b62e-685be80b5df0-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:15 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.306s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Deleted volume successfully. Nov 05 22:26:15 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fb7dfb32-7172-4100-852e-75a6783559ff tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-de903ba2-d62a-4a53-8101-8d3d2a62f36a-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:15 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:15 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" returned: 0 in 0.461s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:15 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0 Nov 05 22:26:15 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:15 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-quobyte-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0" released by "delete_volume" :: held 0.821s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Created reservations ['9c2a6067-7788-479a-8fe4-751d1c9116db', 'f0256371-09ef-4fc0-b70f-a5702780d8fd', '7333d8f3-868c-4237-93c9-4bf5c7eb0ad4', 'fac28469-03bf-4198-a16e-7b25adcea3fa'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:15 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:26:15 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:16 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.261s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:16 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Deleted volume successfully. Nov 05 22:26:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-63e12e3f-85c6-493d-9042-f35a37bab439 tempest-SnapshotDependencyTests-702345106 None] Lock "cinder-7ffdcd75-0cc2-44b0-8e66-7899dbfa20d0-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-b52b1e3d-2eae-4109-b3e5-96878fc428e3 req-18b9d415-2098-426c-86a7-e04a4c3af6a9 tempest-TestInstancesWithCinderVolumes-933327159 None] Terminate volume connection completed successfully. Nov 05 22:26:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-b52b1e3d-2eae-4109-b3e5-96878fc428e3 req-18b9d415-2098-426c-86a7-e04a4c3af6a9 tempest-TestInstancesWithCinderVolumes-933327159 None] Deleting attachment 1986268a-0744-4f15-9ce0-03051356fff1. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:26:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "cinder-d8adbada-127d-4c51-9bc9-e81afd38aba4-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-d8adbada-127d-4c51-9bc9-e81afd38aba4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "cinder-quobyte-d8adbada-127d-4c51-9bc9-e81afd38aba4" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-quobyte-d8adbada-127d-4c51-9bc9-e81afd38aba4" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:19 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fc09fb-517c-43d5-b68a-81929e07afd0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:19 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 Nov 05 22:26:19 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:20 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4" returned: 0 in 0.370s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:20 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4 Nov 05 22:26:20 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:20 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d8adbada-127d-4c51-9bc9-e81afd38aba4" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-quobyte-d8adbada-127d-4c51-9bc9-e81afd38aba4" released by "delete_volume" :: held 0.691s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:20 devstack cinder-volume[87122]: WARNING cinder.quota [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1730214591-1158281187 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1730214591-1158281187, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:26:20 devstack cinder-volume[87122]: WARNING cinder.quota [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1730214591-1158281187 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1730214591-1158281187, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Created reservations ['3fd91834-861a-442d-bf33-09181d5d10af', 'cac7c348-75bb-453e-9109-fb459e900573', '7fd30c7b-8aeb-4900-bd08-09e84c63f552', '28312373-5d3a-449e-b83f-fda0d860ec3f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:20 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:26:20 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:20 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:21 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Deleted volume successfully. Nov 05 22:26:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-538a1ce0-3f92-4f42-961c-0530e8d99582 tempest-TestInstancesWithCinderVolumes-933327159 None] Lock "cinder-d8adbada-127d-4c51-9bc9-e81afd38aba4-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Flow 'volume_create_manager' (94da306b-cef4-4e5d-8d88-0849b291cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da944473-3999-44ee-9a23-9ad8396a9054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da944473-3999-44ee-9a23-9ad8396a9054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-19823723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfed192-9125-457f-a920-bd2c8bf33109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a105a01daeb8457ab70a2adbb25789e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:23Z,use_quota=True,user_id='1257470090d34a63aa80b428a5f66ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e296064-a95e-4e42-ac15-141c2dd4dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e296064-a95e-4e42-ac15-141c2dd4dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cadfb6f-8e1d-46af-95d0-7be971c73599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cadfb6f-8e1d-46af-95d0-7be971c73599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acfed192-9125-457f-a920-bd2c8bf33109', 'volume_name': 'volume-acfed192-9125-457f-a920-bd2c8bf33109', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c35d17-69bb-42c4-8fa0-a4bf9f37ec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c35d17-69bb-42c4-8fa0-a4bf9f37ec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e3e65f-2dff-4f29-88ba-6f97da8df454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Volume acfed192-9125-457f-a920-bd2c8bf33109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acfed192-9125-457f-a920-bd2c8bf33109', 'volume_size': 1} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-19823723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfed192-9125-457f-a920-bd2c8bf33109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a105a01daeb8457ab70a2adbb25789e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:23Z,use_quota=True,user_id='1257470090d34a63aa80b428a5f66ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Creating volume acfed192-9125-457f-a920-bd2c8bf33109 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:22 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:26:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:22 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109 1073741824 Nov 05 22:26:22 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:23 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109 1073741824" returned: 0 in 0.516s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:23 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109 Nov 05 22:26:23 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:23 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e3e65f-2dff-4f29-88ba-6f97da8df454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acfed192-9125-457f-a920-bd2c8bf33109', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2f1012-ff59-4578-818c-7f2c3a5ec792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Volume volume-acfed192-9125-457f-a920-bd2c8bf33109 (acfed192-9125-457f-a920-bd2c8bf33109): created successfully Nov 05 22:26:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2f1012-ff59-4578-818c-7f2c3a5ec792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Flow 'volume_create_manager' (94da306b-cef4-4e5d-8d88-0849b291cc59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-543dc6ec-4ad1-4d86-a91f-f878123f6c7f tempest-AttachVolumeNegativeTest-1784142477 None] Created volume successfully. Nov 05 22:26:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d366836f-ce12-4c54-9c29-7c3f1f6d47bd req-0779cb31-837b-4aaa-b66f-8c7b5b553d52 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d366836f-ce12-4c54-9c29-7c3f1f6d47bd req-0779cb31-837b-4aaa-b66f-8c7b5b553d52 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-d366836f-ce12-4c54-9c29-7c3f1f6d47bd req-0779cb31-837b-4aaa-b66f-8c7b5b553d52 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-d366836f-ce12-4c54-9c29-7c3f1f6d47bd req-0779cb31-837b-4aaa-b66f-8c7b5b553d52 tempest-AttachVolumeNegativeTest-1784142477 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-acfed192-9125-457f-a920-bd2c8bf33109', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebd73e2d-7b01-49c0-9d89-f5f8237c21b4', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:26:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-d366836f-ce12-4c54-9c29-7c3f1f6d47bd req-0779cb31-837b-4aaa-b66f-8c7b5b553d52 tempest-AttachVolumeNegativeTest-1784142477 None] attachment_update completed successfully. Nov 05 22:26:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-f48817f9-d417-4944-a495-cec831d9ae1c req-bd04e23b-ea52-42a8-a3d6-1a630c8dd350 tempest-AttachVolumeNegativeTest-1784142477 None] Terminate volume connection completed successfully. Nov 05 22:26:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-f48817f9-d417-4944-a495-cec831d9ae1c req-bd04e23b-ea52-42a8-a3d6-1a630c8dd350 tempest-AttachVolumeNegativeTest-1784142477 None] Deleting attachment ebd73e2d-7b01-49c0-9d89-f5f8237c21b4. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:26:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "cinder-acfed192-9125-457f-a920-bd2c8bf33109-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-acfed192-9125-457f-a920-bd2c8bf33109-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "cinder-quobyte-acfed192-9125-457f-a920-bd2c8bf33109" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-quobyte-acfed192-9125-457f-a920-bd2c8bf33109" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48f92c0-8e1e-495e-86d5-58d0c68c6e18]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:34 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109 Nov 05 22:26:34 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:34 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109" returned: 0 in 0.376s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:34 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109 Nov 05 22:26:34 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:34 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-acfed192-9125-457f-a920-bd2c8bf33109" returned: 0 in 0.255s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-quobyte-acfed192-9125-457f-a920-bd2c8bf33109" released by "delete_volume" :: held 0.675s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Created reservations ['a1710212-0226-422d-a554-90d7f2308f80', 'd9dbe209-ea1c-4e39-8626-df5fb042b47c', 'f722babf-e0e1-4770-bd77-fa586f1e86ed', '4ce67326-a8ce-4751-b1b9-40b2daa97974'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:34 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:26:34 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:34 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Deleted volume successfully. Nov 05 22:26:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bdf6eba4-9b15-4772-9582-439c39ce8670 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-acfed192-9125-457f-a920-bd2c8bf33109-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "cinder-42def13c-b26b-4e6d-b059-bececa50ccb3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-42def13c-b26b-4e6d-b059-bececa50ccb3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "cinder-quobyte-42def13c-b26b-4e6d-b059-bececa50ccb3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-quobyte-42def13c-b26b-4e6d-b059-bececa50ccb3" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdac4a62-e96c-4394-b3cb-3be6276e8407]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:35 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3 Nov 05 22:26:35 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:35 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3" returned: 0 in 0.379s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:35 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3 Nov 05 22:26:35 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:35 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-42def13c-b26b-4e6d-b059-bececa50ccb3" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-quobyte-42def13c-b26b-4e6d-b059-bececa50ccb3" released by "delete_volume" :: held 0.714s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Created reservations ['e29a743b-d367-49d9-8fb5-e4a79e1c0c8c', 'f50464a7-6167-4b51-879d-2154f4e26a12', '90b9e2e3-8faf-4960-9449-f042fe74b556', '1f4d8bab-2ce0-4c08-af1a-ced6e6b5a56d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:36 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:26:36 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:36 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Deleted volume successfully. Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a19e1a7a-3a35-4668-9164-d75bca52b2d4 tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-42def13c-b26b-4e6d-b059-bececa50ccb3-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "cinder-1522953f-e3da-405b-929f-4c7d11d7d27b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-1522953f-e3da-405b-929f-4c7d11d7d27b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "cinder-quobyte-1522953f-e3da-405b-929f-4c7d11d7d27b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-quobyte-1522953f-e3da-405b-929f-4c7d11d7d27b" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6342ae1d-3a09-4015-8462-f43b9e6735cb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:36 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b Nov 05 22:26:36 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:36 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b" returned: 0 in 0.378s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:36 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b Nov 05 22:26:36 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:37 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1522953f-e3da-405b-929f-4c7d11d7d27b" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-quobyte-1522953f-e3da-405b-929f-4c7d11d7d27b" released by "delete_volume" :: held 0.672s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Created reservations ['931b4ccc-c4c6-4f56-a7d7-cf3f802703f6', '26848979-a5d7-4fb8-b264-95c409fc9d90', '6d862146-50d0-4ffd-a1f3-b267a6c5ba64', '27ce0fb0-f1c4-4db2-ba30-f407985f2880'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:37 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:26:37 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:37 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Deleted volume successfully. Nov 05 22:26:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae4a997a-e757-453e-973b-69d1d1b0c97f tempest-AttachVolumeNegativeTest-1784142477 None] Lock "cinder-1522953f-e3da-405b-929f-4c7d11d7d27b-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:43 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=89,cinder:SELECT=90,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:26:43 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=90,cinder:UPDATE=90,cinder:DELETE=5,cinder:INSERT=19 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Flow 'volume_create_manager' (a2309548-e4cf-43d4-8f78-0e68597d4d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c429bb-23de-4be3-8d8b-657d368045b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c429bb-23de-4be3-8d8b-657d368045b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1948314200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1100556-f7a9-49d0-8c36-4eaaa42452fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1555a92ecae4770b7a83e5d43eab5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:46Z,use_quota=True,user_id='8af2b6f8abfb407296960e322bc21e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a6b257-dc1d-4ce5-8461-a0924ad3dd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a6b257-dc1d-4ce5-8461-a0924ad3dd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7aebe30-6a17-4d66-957e-9d441a1a1e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7aebe30-6a17-4d66-957e-9d441a1a1e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1100556-f7a9-49d0-8c36-4eaaa42452fc', 'volume_name': 'volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5be9cc-025e-4d40-8317-15ff9655c0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5be9cc-025e-4d40-8317-15ff9655c0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4cccf1-6826-40aa-ac45-4d60776a4a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Volume e1100556-f7a9-49d0-8c36-4eaaa42452fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc', 'volume_size': 1} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1948314200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1100556-f7a9-49d0-8c36-4eaaa42452fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1555a92ecae4770b7a83e5d43eab5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:46Z,use_quota=True,user_id='8af2b6f8abfb407296960e322bc21e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Creating volume e1100556-f7a9-49d0-8c36-4eaaa42452fc {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:46 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:46 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc 1073741824 Nov 05 22:26:46 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:46 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc 1073741824" returned: 0 in 0.467s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:46 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc Nov 05 22:26:46 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:47 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc" returned: 0 in 0.255s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4cccf1-6826-40aa-ac45-4d60776a4a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e32b11-eacc-499a-a082-f2b18f21e45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Volume volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc (e1100556-f7a9-49d0-8c36-4eaaa42452fc): created successfully Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e32b11-eacc-499a-a082-f2b18f21e45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Flow 'volume_create_manager' (a2309548-e4cf-43d4-8f78-0e68597d4d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-a88d9762-62cd-46f4-9b24-99501fd4d46c req-a1ead34e-999e-42bb-aec4-6fd0d94cd3dc tempest-VolumesSnapshotsTestJSON-587058846 None] Created volume successfully. Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Creating offline snapshot e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 of volume e1100556-f7a9-49d0-8c36-4eaaa42452fc {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead4ea07-9e67-43b3-9ae4-13eeb142636c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:47 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc Nov 05 22:26:47 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:48 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc" returned: 0 in 0.471s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:48 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 1G Nov 05 22:26:48 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:48 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 1G" returned: 0 in 0.411s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:48 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 Nov 05 22:26:48 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:48 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1" returned: 0 in 0.300s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:48 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 is being set with open permissions: ugo+rw Nov 05 22:26:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:48 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 Nov 05 22:26:48 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:49 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1" returned: 0 in 0.267s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:49 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.info Nov 05 22:26:49 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:49 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.info" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:49 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.info is being set with open permissions: ugo+rw Nov 05 22:26:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:49 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.info Nov 05 22:26:49 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:49 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.info" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-f0f74226-112f-4718-b232-f269f8e2e980 req-2b94865b-5209-4ef6-8b9f-0f1bb01d00e6 tempest-VolumesSnapshotsTestJSON-587058846 None] Create snapshot completed successfully Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Acquiring lock "cinder-e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "cinder-e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Acquiring lock "cinder-quobyte-e1100556-f7a9-49d0-8c36-4eaaa42452fc" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "cinder-quobyte-e1100556-f7a9-49d0-8c36-4eaaa42452fc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Acquiring lock "cinder-quobyte-e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "cinder-quobyte-e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Deleting offline snapshot e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 of volume e1100556-f7a9-49d0-8c36-4eaaa42452fc {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] snapshot_file for this snap is: volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[98687642-fe98-405a-ad27-d0906b779a2c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:50 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 Nov 05 22:26:50 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:50 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1" returned: 0 in 0.367s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5ee094-f77c-4942-82de-cf35e1419434]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:50 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc Nov 05 22:26:50 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:51 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc" returned: 0 in 0.480s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:51 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 Nov 05 22:26:51 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:51 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1" returned: 0 in 0.422s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:51 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1 Nov 05 22:26:51 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:51 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc.e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "cinder-quobyte-e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1" released by "_delete_snapshot" :: held 1.645s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "cinder-quobyte-e1100556-f7a9-49d0-8c36-4eaaa42452fc" released by "delete_snapshot" :: held 1.675s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:52 devstack cinder-volume[87122]: DEBUG cinder.quota [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Created reservations ['baa85c8f-14ec-4d22-a278-58085d7aea35', 'a50cd15b-a15b-499b-bd0e-b8456e8bf781', '655f3ed6-d54e-4687-ae41-bcb0599c066b', 'a684f116-8a85-43b2-8633-3193fa23ed88'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:52 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Delete snapshot completed successfully. Nov 05 22:26:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-d60feeb9-5d86-4e4d-b8d9-e53faf4ebf33 req-1b1efb80-b1db-4b28-ac26-a810f6ad180f tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "cinder-e9bb87f2-3e5d-4fd7-a55e-9ea573656dd1-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Acquiring lock "cinder-e1100556-f7a9-49d0-8c36-4eaaa42452fc-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "cinder-e1100556-f7a9-49d0-8c36-4eaaa42452fc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Acquiring lock "cinder-quobyte-e1100556-f7a9-49d0-8c36-4eaaa42452fc" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "cinder-quobyte-e1100556-f7a9-49d0-8c36-4eaaa42452fc" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[831881d1-63e8-4af3-9237-04f275ea3c48]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:52 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc Nov 05 22:26:52 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:53 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc" returned: 0 in 0.415s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:53 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc Nov 05 22:26:53 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:53 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e1100556-f7a9-49d0-8c36-4eaaa42452fc" returned: 0 in 0.256s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "cinder-quobyte-e1100556-f7a9-49d0-8c36-4eaaa42452fc" released by "delete_volume" :: held 0.748s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG cinder.quota [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Created reservations ['18d0c2f5-0844-42c8-ad2b-8deb267a58d2', '2b8c3e09-2beb-45ec-986a-4cff6ef576ec', 'fea48b26-a2e2-43c7-a477-0ea271613885', '1cfc5b90-831d-4ff1-ad25-864cffea78c7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:53 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:26:53 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:53 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.317s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG cinder.manager [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Deleted volume successfully. Nov 05 22:26:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [req-a4889139-8b76-424b-8190-8410d38b78f1 req-194a4576-883a-49c5-8b45-3c95a7c7e2c0 tempest-VolumesSnapshotsTestJSON-587058846 None] Lock "cinder-e1100556-f7a9-49d0-8c36-4eaaa42452fc-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:57 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:26:57 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:57 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.261s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:26:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:27:03 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=20,cinder:SELECT=18,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:27:03 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=14,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:27:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d4a9d233-de6a-49b5-badb-e11b0d1caf8a tempest-GroupsTest-936672936 None] Group tempest-Group1-1610389995: creating Nov 05 22:27:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d4a9d233-de6a-49b5-badb-e11b0d1caf8a tempest-GroupsTest-936672936 None] Group tempest-Group1-1610389995: created successfully Nov 05 22:27:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d4a9d233-de6a-49b5-badb-e11b0d1caf8a tempest-GroupsTest-936672936 None] Create group completed successfully. Nov 05 22:27:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-adab2366-4184-4abe-b89f-6af284b7295c tempest-GroupsTest-936672936 None] Group tempest-Group2-1755259042: creating Nov 05 22:27:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-adab2366-4184-4abe-b89f-6af284b7295c tempest-GroupsTest-936672936 None] Group tempest-Group2-1755259042: created successfully Nov 05 22:27:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-adab2366-4184-4abe-b89f-6af284b7295c tempest-GroupsTest-936672936 None] Create group completed successfully. Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Flow 'volume_create_manager' (b20ec55e-6ca5-41c0-a162-43eaafd5c4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f282dab5-6881-417d-b7f9-1c0b0d122b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f282dab5-6881-417d-b7f9-1c0b0d122b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-334510899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e38c8eb6-825f-4f4e-a891-6b880f281d9d,host='devstack@QuobyteHD#QuobyteHD',id=050b3cd0-39f9-402c-863a-c1a9e907542c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a858f5948946dc8585d5a5907db075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:08Z,use_quota=True,user_id='5d68ce83502d47ca88f1767dd281e19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97dc4c7b-43ac-4543-b0bf-2291fd82229a),volume_type_id=97dc4c7b-43ac-4543-b0bf-2291fd82229a)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191e66f6-a663-456c-8f0c-855569438a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191e66f6-a663-456c-8f0c-855569438a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad98b7b-4eee-4ee1-9ee4-4ed07ad2a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad98b7b-4eee-4ee1-9ee4-4ed07ad2a190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '050b3cd0-39f9-402c-863a-c1a9e907542c', 'volume_name': 'volume-050b3cd0-39f9-402c-863a-c1a9e907542c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d67b23-8f46-456f-a5da-f795f5a86860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d67b23-8f46-456f-a5da-f795f5a86860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61778a1-359c-49ac-96a0-a761f071a104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Volume 050b3cd0-39f9-402c-863a-c1a9e907542c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-050b3cd0-39f9-402c-863a-c1a9e907542c', 'volume_size': 1} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e38c8eb6-825f-4f4e-a891-6b880f281d9d,created_at=2026-11-05T21:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-334510899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e38c8eb6-825f-4f4e-a891-6b880f281d9d,host='devstack@QuobyteHD#QuobyteHD',id=050b3cd0-39f9-402c-863a-c1a9e907542c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a858f5948946dc8585d5a5907db075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:08Z,use_quota=True,user_id='5d68ce83502d47ca88f1767dd281e19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97dc4c7b-43ac-4543-b0bf-2291fd82229a),volume_type_id=97dc4c7b-43ac-4543-b0bf-2291fd82229a)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Creating volume 050b3cd0-39f9-402c-863a-c1a9e907542c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:08 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:08 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c 1073741824 Nov 05 22:27:08 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Flow 'volume_create_manager' (cd4755c2-af74-4ac5-b7a6-c8f200ee577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf5909-fad6-4916-8b74-6a744ac2a9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bf5909-fad6-4916-8b74-6a744ac2a9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1743852978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6850725-3861-4988-93a7-056ec4aad12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f809133a5a794ab49ed3858cd694dad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:08Z,use_quota=True,user_id='7ac698627ba340d2a384cc1ece684fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fe73a6-9e96-460f-acaf-5697962166b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6fe73a6-9e96-460f-acaf-5697962166b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29c0bf3-1be2-429c-8c04-462012f5ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29c0bf3-1be2-429c-8c04-462012f5ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6850725-3861-4988-93a7-056ec4aad12a', 'volume_name': 'volume-c6850725-3861-4988-93a7-056ec4aad12a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec1a8c3-4ad7-4ecc-8da6-f62b7f5f12a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec1a8c3-4ad7-4ecc-8da6-f62b7f5f12a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f82ad5-330e-4d07-96ba-edbdf789c333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Volume c6850725-3861-4988-93a7-056ec4aad12a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6850725-3861-4988-93a7-056ec4aad12a', 'volume_size': 1} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:08 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c 1073741824" returned: 0 in 0.533s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:08 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c Nov 05 22:27:08 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:08 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1743852978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6850725-3861-4988-93a7-056ec4aad12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f809133a5a794ab49ed3858cd694dad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:08Z,use_quota=True,user_id='7ac698627ba340d2a384cc1ece684fa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Creating volume c6850725-3861-4988-93a7-056ec4aad12a {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:08 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:27:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61778a1-359c-49ac-96a0-a761f071a104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-050b3cd0-39f9-402c-863a-c1a9e907542c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:09 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a 1073741824 Nov 05 22:27:09 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed7c856-3bb0-4408-92ad-360c655ea4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:09 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Volume volume-050b3cd0-39f9-402c-863a-c1a9e907542c (050b3cd0-39f9-402c-863a-c1a9e907542c): created successfully Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed7c856-3bb0-4408-92ad-360c655ea4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Flow 'volume_create_manager' (b20ec55e-6ca5-41c0-a162-43eaafd5c4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-70ef449b-a0ed-4bbf-bf26-9520b49d5202 tempest-GroupsTest-936672936 None] Created volume successfully. Nov 05 22:27:09 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a 1073741824" returned: 0 in 0.514s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:09 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a Nov 05 22:27:09 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:09 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f82ad5-330e-4d07-96ba-edbdf789c333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6850725-3861-4988-93a7-056ec4aad12a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f4599b-0183-4d7f-ad82-7512b0fd5c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:09 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Volume volume-c6850725-3861-4988-93a7-056ec4aad12a (c6850725-3861-4988-93a7-056ec4aad12a): created successfully Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f4599b-0183-4d7f-ad82-7512b0fd5c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Flow 'volume_create_manager' (cd4755c2-af74-4ac5-b7a6-c8f200ee577c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-178913ef-f3c6-418f-8e91-9ff7132349fc tempest-TestMinimumBasicScenario-964497226 None] Created volume successfully. Nov 05 22:27:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Acquiring lock "cinder-quobyte-050b3cd0-39f9-402c-863a-c1a9e907542c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Lock "cinder-quobyte-050b3cd0-39f9-402c-863a-c1a9e907542c" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58bd106-38f2-4bd4-a4e5-0abdf35db348]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:10 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c Nov 05 22:27:10 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:10 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c" returned: 0 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:10 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c Nov 05 22:27:10 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:10 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-050b3cd0-39f9-402c-863a-c1a9e907542c" returned: 0 in 0.327s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Lock "cinder-quobyte-050b3cd0-39f9-402c-863a-c1a9e907542c" released by "delete_volume" :: held 0.722s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Created reservations ['ad77fd80-8dd6-4088-abca-5108cbcd54aa'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:10 devstack cinder-volume[87122]: WARNING cinder.quota [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1701216759 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1701216759, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:27:10 devstack cinder-volume[87122]: WARNING cinder.quota [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1701216759 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1701216759, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:27:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Created reservations ['6d4b86eb-753b-4f69-842b-db0ae3f145d7', '054e8b3d-7925-4bba-b5ff-196c15ff6296', '90bc8abd-567d-41c9-a2d8-16059f40095c', '4e56156d-cff9-4191-8e1b-46fec8e476d5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:11 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:27:11 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:11 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c0944a51-dea8-44dd-8384-8fb18d6235e5 tempest-GroupsTest-936672936 None] Delete group completed successfully. Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a4ec1272-a7bd-444b-b39e-abe53b435dd2 tempest-GroupsTest-936672936 None] Created reservations ['5707a3b7-f88a-415f-a871-482e98da1f82'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a4ec1272-a7bd-444b-b39e-abe53b435dd2 tempest-GroupsTest-936672936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a4ec1272-a7bd-444b-b39e-abe53b435dd2 tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec1272-a7bd-444b-b39e-abe53b435dd2 tempest-GroupsTest-936672936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a4ec1272-a7bd-444b-b39e-abe53b435dd2 tempest-GroupsTest-936672936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a4ec1272-a7bd-444b-b39e-abe53b435dd2 tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a4ec1272-a7bd-444b-b39e-abe53b435dd2 tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:11 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:27:11 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5038356f-56cf-4eda-b002-e5ce340b98c4 req-f9c54d04-6ea0-4d1f-8db7-24d33a465605 tempest-TestMinimumBasicScenario-964497226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5038356f-56cf-4eda-b002-e5ce340b98c4 req-f9c54d04-6ea0-4d1f-8db7-24d33a465605 tempest-TestMinimumBasicScenario-964497226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-5038356f-56cf-4eda-b002-e5ce340b98c4 req-f9c54d04-6ea0-4d1f-8db7-24d33a465605 tempest-TestMinimumBasicScenario-964497226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-5038356f-56cf-4eda-b002-e5ce340b98c4 req-f9c54d04-6ea0-4d1f-8db7-24d33a465605 tempest-TestMinimumBasicScenario-964497226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-c6850725-3861-4988-93a7-056ec4aad12a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '826f12b5-08ff-4e47-8d39-f82617569d42', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:27:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-5038356f-56cf-4eda-b002-e5ce340b98c4 req-f9c54d04-6ea0-4d1f-8db7-24d33a465605 tempest-TestMinimumBasicScenario-964497226 None] attachment_update completed successfully. Nov 05 22:27:11 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a4ec1272-a7bd-444b-b39e-abe53b435dd2 tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.292s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a4ec1272-a7bd-444b-b39e-abe53b435dd2 tempest-GroupsTest-936672936 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a4ec1272-a7bd-444b-b39e-abe53b435dd2 tempest-GroupsTest-936672936 None] Delete group completed successfully. Nov 05 22:27:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-47ae01f9-0209-4da3-ba4a-cdc79bd58715 tempest-GroupsTest-936672936 None] Group tempest-GroupsTest-Group-1846522209: creating Nov 05 22:27:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-47ae01f9-0209-4da3-ba4a-cdc79bd58715 tempest-GroupsTest-936672936 None] Group tempest-GroupsTest-Group-1846522209: created successfully Nov 05 22:27:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-47ae01f9-0209-4da3-ba4a-cdc79bd58715 tempest-GroupsTest-936672936 None] Create group completed successfully. Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Flow 'volume_create_manager' (985f6057-c34c-4647-8d4f-518593ce3d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43adab3-918e-42dd-b382-8d92755d2321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43adab3-918e-42dd-b382-8d92755d2321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-632029069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=199f2d30-15e6-4870-b367-441469cd6561,host='devstack@QuobyteHD#QuobyteHD',id=7d971097-6308-42ac-9dd0-ede6beff13c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a858f5948946dc8585d5a5907db075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:15Z,use_quota=True,user_id='5d68ce83502d47ca88f1767dd281e19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7c77fc0-4184-4bf7-a8c7-dac83853a828),volume_type_id=f7c77fc0-4184-4bf7-a8c7-dac83853a828)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404f7f92-9d24-4075-93ad-6be2d7e02b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404f7f92-9d24-4075-93ad-6be2d7e02b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512d4b9d-416a-491e-9b65-2e88688c150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512d4b9d-416a-491e-9b65-2e88688c150f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d971097-6308-42ac-9dd0-ede6beff13c5', 'volume_name': 'volume-7d971097-6308-42ac-9dd0-ede6beff13c5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea235484-3856-41b6-9d2a-48c3aea966ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea235484-3856-41b6-9d2a-48c3aea966ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1103a0c3-5480-4fdd-b8cf-df4faab7a7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Volume 7d971097-6308-42ac-9dd0-ede6beff13c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d971097-6308-42ac-9dd0-ede6beff13c5', 'volume_size': 1} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=199f2d30-15e6-4870-b367-441469cd6561,created_at=2026-11-05T21:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-632029069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=199f2d30-15e6-4870-b367-441469cd6561,host='devstack@QuobyteHD#QuobyteHD',id=7d971097-6308-42ac-9dd0-ede6beff13c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a858f5948946dc8585d5a5907db075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:15Z,use_quota=True,user_id='5d68ce83502d47ca88f1767dd281e19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7c77fc0-4184-4bf7-a8c7-dac83853a828),volume_type_id=f7c77fc0-4184-4bf7-a8c7-dac83853a828)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Creating volume 7d971097-6308-42ac-9dd0-ede6beff13c5 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:14 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:27:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:14 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5 1073741824 Nov 05 22:27:14 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:15 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5 1073741824" returned: 0 in 0.468s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:15 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5 Nov 05 22:27:15 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:15 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1103a0c3-5480-4fdd-b8cf-df4faab7a7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d971097-6308-42ac-9dd0-ede6beff13c5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fcc6aae-ec16-4431-9ae2-cf01b204a0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Volume volume-7d971097-6308-42ac-9dd0-ede6beff13c5 (7d971097-6308-42ac-9dd0-ede6beff13c5): created successfully Nov 05 22:27:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fcc6aae-ec16-4431-9ae2-cf01b204a0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Flow 'volume_create_manager' (985f6057-c34c-4647-8d4f-518593ce3d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6df4b956-0939-4cbd-bb17-fba325d11a2b tempest-GroupsTest-936672936 None] Created volume successfully. Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Flow 'volume_create_manager' (7982019d-01f5-410e-98bd-c73385b6ba2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cff202-c735-4c11-b358-590d16e5f548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cff202-c735-4c11-b358-590d16e5f548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-400774398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=199f2d30-15e6-4870-b367-441469cd6561,host='devstack@QuobyteHD#QuobyteHD',id=939cdc4e-9623-482e-bfc4-cf40411180e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a858f5948946dc8585d5a5907db075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:17Z,use_quota=True,user_id='5d68ce83502d47ca88f1767dd281e19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7c77fc0-4184-4bf7-a8c7-dac83853a828),volume_type_id=f7c77fc0-4184-4bf7-a8c7-dac83853a828)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54fb1e8-301d-430b-8f19-4c2b26c8f416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54fb1e8-301d-430b-8f19-4c2b26c8f416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6477a782-a1e9-454a-96ae-e55744999b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6477a782-a1e9-454a-96ae-e55744999b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '939cdc4e-9623-482e-bfc4-cf40411180e9', 'volume_name': 'volume-939cdc4e-9623-482e-bfc4-cf40411180e9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3947261-f1eb-41a0-ab28-d93c18ddaf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3947261-f1eb-41a0-ab28-d93c18ddaf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706d1c4b-0c0a-4aca-a944-0fe044387c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Volume 939cdc4e-9623-482e-bfc4-cf40411180e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-939cdc4e-9623-482e-bfc4-cf40411180e9', 'volume_size': 1} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=199f2d30-15e6-4870-b367-441469cd6561,created_at=2026-11-05T21:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-400774398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=199f2d30-15e6-4870-b367-441469cd6561,host='devstack@QuobyteHD#QuobyteHD',id=939cdc4e-9623-482e-bfc4-cf40411180e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74a858f5948946dc8585d5a5907db075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:17Z,use_quota=True,user_id='5d68ce83502d47ca88f1767dd281e19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7c77fc0-4184-4bf7-a8c7-dac83853a828),volume_type_id=f7c77fc0-4184-4bf7-a8c7-dac83853a828)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Creating volume 939cdc4e-9623-482e-bfc4-cf40411180e9 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:16 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:27:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:17 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9 1073741824 Nov 05 22:27:17 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:17 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9 1073741824" returned: 0 in 0.619s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:17 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9 Nov 05 22:27:17 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:17 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706d1c4b-0c0a-4aca-a944-0fe044387c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939cdc4e-9623-482e-bfc4-cf40411180e9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799fe30c-6ae0-4848-90ee-d559de9bb0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Volume volume-939cdc4e-9623-482e-bfc4-cf40411180e9 (939cdc4e-9623-482e-bfc4-cf40411180e9): created successfully Nov 05 22:27:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799fe30c-6ae0-4848-90ee-d559de9bb0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Flow 'volume_create_manager' (7982019d-01f5-410e-98bd-c73385b6ba2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0a966784-6cdf-4625-9bb7-6f6d2d54b48b tempest-GroupsTest-936672936 None] Created volume successfully. Nov 05 22:27:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-362e9438-7416-4da7-af6b-2f2baf5cc8cd tempest-GroupsTest-936672936 None] Update group completed successfully. Nov 05 22:27:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7cd8e2b1-aa61-4e49-8772-d37f7b8d4f93 tempest-GroupsTest-936672936 None] Update group completed successfully. Nov 05 22:27:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Acquiring lock "cinder-quobyte-7d971097-6308-42ac-9dd0-ede6beff13c5" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Lock "cinder-quobyte-7d971097-6308-42ac-9dd0-ede6beff13c5" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d87f33-8fd2-496c-aafd-8e21e32315f2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:22 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5 Nov 05 22:27:22 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:22 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5" returned: 0 in 0.352s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:22 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5 Nov 05 22:27:22 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:22 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7d971097-6308-42ac-9dd0-ede6beff13c5" returned: 0 in 0.246s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Lock "cinder-quobyte-7d971097-6308-42ac-9dd0-ede6beff13c5" released by "delete_volume" :: held 0.638s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Acquiring lock "cinder-quobyte-939cdc4e-9623-482e-bfc4-cf40411180e9" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Lock "cinder-quobyte-939cdc4e-9623-482e-bfc4-cf40411180e9" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[21822d6b-e273-4202-953e-64ccb76ceaa9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:23 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9 Nov 05 22:27:23 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:23 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9" returned: 0 in 0.346s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:23 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9 Nov 05 22:27:23 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:23 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-939cdc4e-9623-482e-bfc4-cf40411180e9" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Lock "cinder-quobyte-939cdc4e-9623-482e-bfc4-cf40411180e9" released by "delete_volume" :: held 0.628s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Created reservations ['2ebbc81b-86eb-4b20-aaf3-1a2a62005f4e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:23 devstack cinder-volume[87122]: WARNING cinder.quota [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-990883147 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-990883147, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:27:23 devstack cinder-volume[87122]: WARNING cinder.quota [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-990883147 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-990883147, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Created reservations ['ca4fd524-2f66-4c95-a506-e778052e0f21', '24dfd79e-079c-4f72-8580-8613f366b53b', 'a289f44d-b9d4-4e41-aa6e-fb2e24906353', 'd2fedaa3-8ba5-4da1-ab6e-474fd3817cb5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Created reservations ['ea15259f-733b-48ec-9d5d-a326ccbb7961', '8579e15c-e94b-48be-8348-3ce0db83796b', '4732f72c-a7ff-459a-987b-fb23c06eb1c7', '413abb18-23dc-40f4-b169-66581cc2b70a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:23 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:27:23 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:24 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:24 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-beefafc5-2f8c-43b2-acd9-def523d60f7f tempest-GroupsTest-936672936 None] Delete group completed successfully. Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Flow 'volume_create_manager' (49482c0d-ebfc-446f-80fb-e8889170b2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c667dc9e-27d9-47f5-869c-aa4aeb8739ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c667dc9e-27d9-47f5-869c-aa4aeb8739ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1683690621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99165bf-5cbd-4ede-9172-22dda194f865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1a24add4284529b8e5c52bad2d88c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:30Z,use_quota=True,user_id='8c8dd7a7df464809987db4a22cb3c4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a245ba-df0e-4572-bef0-ff54686100af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a245ba-df0e-4572-bef0-ff54686100af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def44fc0-2cf2-4bf8-b0cf-f763305adede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def44fc0-2cf2-4bf8-b0cf-f763305adede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b99165bf-5cbd-4ede-9172-22dda194f865', 'volume_name': 'volume-b99165bf-5cbd-4ede-9172-22dda194f865', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d5b79a-12c6-4639-b87d-2bc17dfbfad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d5b79a-12c6-4639-b87d-2bc17dfbfad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45e0ee4-fe45-4230-b146-1f2208f4afbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Volume b99165bf-5cbd-4ede-9172-22dda194f865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b99165bf-5cbd-4ede-9172-22dda194f865', 'volume_size': 1} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1683690621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99165bf-5cbd-4ede-9172-22dda194f865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1a24add4284529b8e5c52bad2d88c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:30Z,use_quota=True,user_id='8c8dd7a7df464809987db4a22cb3c4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Creating volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:30 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:30 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 1073741824 Nov 05 22:27:30 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:30 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 1073741824" returned: 0 in 0.416s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:30 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 Nov 05 22:27:30 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:31 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865" returned: 0 in 0.236s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45e0ee4-fe45-4230-b146-1f2208f4afbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b99165bf-5cbd-4ede-9172-22dda194f865', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b8c62e-0ea9-4f35-a224-06691df9f01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Volume volume-b99165bf-5cbd-4ede-9172-22dda194f865 (b99165bf-5cbd-4ede-9172-22dda194f865): created successfully Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b8c62e-0ea9-4f35-a224-06691df9f01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Flow 'volume_create_manager' (49482c0d-ebfc-446f-80fb-e8889170b2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f7121662-c594-46bb-971a-fa2d839e44c8 tempest-SnapshotsActionsTest-1977521213 None] Created volume successfully. Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Creating offline snapshot 4dbd9ac2-5f43-413d-9bfb-07283a4d9cec of volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aff317e-d0ab-4fe9-b393-f2c553df0129]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:31 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 Nov 05 22:27:31 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:31 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865" returned: 0 in 0.403s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:31 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec 1G Nov 05 22:27:31 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:32 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec 1G" returned: 0 in 0.433s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:32 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:32 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:32 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:32 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec is being set with open permissions: ugo+rw Nov 05 22:27:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:32 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:32 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:32 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.246s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:32 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.info Nov 05 22:27:32 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:33 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.info" returned: 0 in 0.332s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:33 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.info is being set with open permissions: ugo+rw Nov 05 22:27:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:33 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.info Nov 05 22:27:33 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:33 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.info" returned: 0 in 0.267s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.090s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8de07d82-6916-4cbd-bde9-bfa22ed067f2 tempest-SnapshotsActionsTest-1977521213 None] Create snapshot completed successfully Nov 05 22:27:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] Creating offline snapshot c1d0f5e2-c3a8-464a-86ef-4e958ec44167 of volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:27:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4da761e-3503-4628-a440-1c6cfbe195f2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:35 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:35 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:35 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.375s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:35 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 1G Nov 05 22:27:35 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:35 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 1G" returned: 0 in 0.415s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:36 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 Nov 05 22:27:36 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:36 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167" returned: 0 in 0.289s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:36 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 is being set with open permissions: ugo+rw Nov 05 22:27:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:36 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 Nov 05 22:27:36 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:36 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.449s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f05ee922-01fc-4145-b347-bb32e968c8ac tempest-SnapshotsActionsTest-1977521213 None] Create snapshot completed successfully Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-c1d0f5e2-c3a8-464a-86ef-4e958ec44167-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-c1d0f5e2-c3a8-464a-86ef-4e958ec44167-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-quobyte-c1d0f5e2-c3a8-464a-86ef-4e958ec44167" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-c1d0f5e2-c3a8-464a-86ef-4e958ec44167" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Deleting offline snapshot c1d0f5e2-c3a8-464a-86ef-4e958ec44167 of volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] snapshot_file for this snap is: volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6287a1ea-44ea-4bef-8184-411082cc03c9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:37 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 Nov 05 22:27:37 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:37 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167" returned: 0 in 0.387s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee77b6c-0e15-47be-93b9-27d1e03e6958]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:37 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:37 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:38 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:38 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 Nov 05 22:27:38 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:38 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:38 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167 Nov 05 22:27:38 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:38 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.c1d0f5e2-c3a8-464a-86ef-4e958ec44167" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-c1d0f5e2-c3a8-464a-86ef-4e958ec44167" released by "_delete_snapshot" :: held 1.475s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" released by "delete_snapshot" :: held 1.499s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:38 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Created reservations ['abb03dc6-9282-4ef5-a085-9608bedc50bc', '2b93a79c-7e4d-4821-bb8f-0217025d59e6', '74fb33c2-200d-404f-9f3b-98d784b9d80b', '7d06be6d-7ae2-4cf5-bdb8-25358dcecb21'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Delete snapshot completed successfully. Nov 05 22:27:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e0b6dbd3-4272-4fac-ae58-41523d6c1b8a tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-c1d0f5e2-c3a8-464a-86ef-4e958ec44167-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] Creating offline snapshot 6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 of volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:27:39 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a7916-aa98-4daf-9a7b-26688547be6b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:39 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:39 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:40 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.385s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:40 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 1G Nov 05 22:27:40 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:40 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 1G" returned: 0 in 0.419s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:40 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 Nov 05 22:27:40 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:40 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:40 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 is being set with open permissions: ugo+rw Nov 05 22:27:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:40 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 Nov 05 22:27:40 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:41 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.444s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-569431dd-13e4-42a6-a5e0-671c60ff0d47 tempest-SnapshotsActionsTest-1977521213 None] Create snapshot completed successfully Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-quobyte-6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Deleting offline snapshot 6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 of volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] snapshot_file for this snap is: volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7904b470-f947-470d-ae51-930f972e4637]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:42 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 Nov 05 22:27:42 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:42 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8" returned: 0 in 0.362s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a4ecc7-ed71-4046-9d0e-b4b2cae7f7e6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:42 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:42 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:42 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:42 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 Nov 05 22:27:42 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:43 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8" returned: 0 in 0.375s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:43 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8 Nov 05 22:27:43 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:43 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8" released by "_delete_snapshot" :: held 1.456s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" released by "delete_snapshot" :: held 1.491s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Created reservations ['dee2fe80-c95e-49c6-bf8b-f4eaff577e5a', '64535415-dd60-4e9a-8ca2-0c1135f70682', '6d9ad32f-6255-4542-bd29-ac1bee96bb07', 'c5d55270-d4c2-4bcf-b0e2-b8e9a88e4a81'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Delete snapshot completed successfully. Nov 05 22:27:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c4ec8090-a99c-4c78-9f34-cd8881c6ead2 tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-6968babd-a9a2-4ebc-9e2f-1d6bee50f4f8-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] Creating offline snapshot 151659c5-f805-4231-bfe6-98644c0762b8 of volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:27:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38dd21a-09ec-4331-9eb8-740147b1e991]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:44 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:44 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:44 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:44 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 1G Nov 05 22:27:44 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:45 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 1G" returned: 0 in 0.435s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:45 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 Nov 05 22:27:45 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:45 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:45 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 is being set with open permissions: ugo+rw Nov 05 22:27:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:45 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 Nov 05 22:27:45 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:45 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8" returned: 0 in 0.234s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.456s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-19d3c674-458c-4b0d-a34a-777d803071f2 tempest-SnapshotsActionsTest-1977521213 None] Create snapshot completed successfully Nov 05 22:27:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-151659c5-f805-4231-bfe6-98644c0762b8-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-151659c5-f805-4231-bfe6-98644c0762b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-quobyte-151659c5-f805-4231-bfe6-98644c0762b8" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-151659c5-f805-4231-bfe6-98644c0762b8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Deleting offline snapshot 151659c5-f805-4231-bfe6-98644c0762b8 of volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:27:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] snapshot_file for this snap is: volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:27:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c20e819-5b76-46e2-b729-1ee14ae891f2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:46 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 Nov 05 22:27:46 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:47 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3688cd-21fe-4bc0-b1b5-d690fc0c695b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:47 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:47 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:47 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.344s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:47 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 Nov 05 22:27:47 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:47 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8" returned: 0 in 0.355s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:47 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8 Nov 05 22:27:47 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:48 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.151659c5-f805-4231-bfe6-98644c0762b8" returned: 0 in 0.246s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-151659c5-f805-4231-bfe6-98644c0762b8" released by "_delete_snapshot" :: held 1.386s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" released by "delete_snapshot" :: held 1.405s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:48 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Created reservations ['b07f749a-918c-47ca-9355-f7860ea0da4d', '1688e25d-7105-4313-a645-505ebe84c47a', '33e7f4a3-cec0-4813-b1a4-b8b47a988da6', '2d6142fd-016b-42fc-b4b5-a014f7c466d1'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Delete snapshot completed successfully. Nov 05 22:27:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f495dd76-6999-42b6-b88d-15df86f6382b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-151659c5-f805-4231-bfe6-98644c0762b8-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] Creating offline snapshot 514f14eb-a668-47f1-9759-6fb1945f7c9f of volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:27:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2172e33b-ad51-48bc-9934-1a97ef170faf]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:49 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:49 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:49 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.357s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:49 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f 1G Nov 05 22:27:49 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:49 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f 1G" returned: 0 in 0.429s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:49 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f Nov 05 22:27:49 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:50 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f" returned: 0 in 0.284s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:50 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f is being set with open permissions: ugo+rw Nov 05 22:27:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:50 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f Nov 05 22:27:50 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:50 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f" returned: 0 in 0.236s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.404s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8c4cc6f5-6980-4a7e-8c2b-7011d5b891e8 tempest-SnapshotsActionsTest-1977521213 None] Create snapshot completed successfully Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-514f14eb-a668-47f1-9759-6fb1945f7c9f-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-514f14eb-a668-47f1-9759-6fb1945f7c9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Acquiring lock "cinder-quobyte-514f14eb-a668-47f1-9759-6fb1945f7c9f" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-514f14eb-a668-47f1-9759-6fb1945f7c9f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Deleting offline snapshot 514f14eb-a668-47f1-9759-6fb1945f7c9f of volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] snapshot_file for this snap is: volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[825d9341-73f4-4fed-8519-1220ba7c0602]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:51 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f Nov 05 22:27:51 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:51 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fa0868-9709-424b-b57a-936eebe6717c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:51 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:51 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:52 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.366s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:52 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f Nov 05 22:27:52 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:52 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f" returned: 0 in 0.428s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:52 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f Nov 05 22:27:52 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:52 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.514f14eb-a668-47f1-9759-6fb1945f7c9f" returned: 0 in 0.287s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-514f14eb-a668-47f1-9759-6fb1945f7c9f" released by "_delete_snapshot" :: held 1.549s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" released by "delete_snapshot" :: held 1.570s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Created reservations ['25d12b79-455b-42fe-a0d5-66f130a30db4', 'dd5dcf0b-3c40-4b29-8d86-7547f8376dad', '0e479c4f-a37f-4994-a6c2-69f9a5c71edd', 'eda3977f-a1f6-4638-8b38-5b568162d864'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Delete snapshot completed successfully. Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4fbd1c5-e5ab-417a-b703-575fec8ca21b tempest-SnapshotsActionsTest-1057443454 None] Lock "cinder-514f14eb-a668-47f1-9759-6fb1945f7c9f-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "cinder-4dbd9ac2-5f43-413d-9bfb-07283a4d9cec-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Lock "cinder-4dbd9ac2-5f43-413d-9bfb-07283a4d9cec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "cinder-quobyte-4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Lock "cinder-quobyte-4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Deleting offline snapshot 4dbd9ac2-5f43-413d-9bfb-07283a4d9cec of volume b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] snapshot_file for this snap is: volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8b3a25-22c5-4aa7-b78a-3539c5ae20b2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:54 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:54 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:54 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99165bf-5cbd-4ede-9172-22dda194f865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ce5f70-7db3-41b7-ac7f-1577fae64983]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:54 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 Nov 05 22:27:54 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:54 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865" returned: 0 in 0.379s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:54 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:54 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:55 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.374s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:55 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec Nov 05 22:27:55 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:55 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865.4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" returned: 0 in 0.309s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Lock "cinder-quobyte-4dbd9ac2-5f43-413d-9bfb-07283a4d9cec" released by "_delete_snapshot" :: held 1.560s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" released by "delete_snapshot" :: held 1.589s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:55 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Created reservations ['baec169e-6902-47fb-9b09-ac8150071c78', '60a926f4-2410-4802-9fa9-ebd3db683edf', '9d0c07b1-4374-4b7b-8e22-9430ec1715fd', '981453ae-1ef3-4d83-aab8-bbd675a6f782'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Delete snapshot completed successfully. Nov 05 22:27:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c0aa3d2-5cf9-43ae-a19e-4a94881955ba tempest-SnapshotsActionsTest-1977521213 None] Lock "cinder-4dbd9ac2-5f43-413d-9bfb-07283a4d9cec-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "cinder-b99165bf-5cbd-4ede-9172-22dda194f865-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Lock "cinder-b99165bf-5cbd-4ede-9172-22dda194f865-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a754147b-94e0-4655-97a9-b72426417f4e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:56 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 Nov 05 22:27:56 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:56 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865" returned: 0 in 0.406s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:56 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865 Nov 05 22:27:56 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:56 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b99165bf-5cbd-4ede-9172-22dda194f865" returned: 0 in 0.256s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Lock "cinder-quobyte-b99165bf-5cbd-4ede-9172-22dda194f865" released by "delete_volume" :: held 0.769s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-139bc36a-2d3f-4b84-a2ca-b2bf855b206d req-e94ac8cd-8ba1-412d-9d59-7787e3dd41c9 tempest-TestMinimumBasicScenario-964497226 None] Terminate volume connection completed successfully. Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-139bc36a-2d3f-4b84-a2ca-b2bf855b206d req-e94ac8cd-8ba1-412d-9d59-7787e3dd41c9 tempest-TestMinimumBasicScenario-964497226 None] Deleting attachment 826f12b5-08ff-4e47-8d39-f82617569d42. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Created reservations ['5999e6e2-c604-4a9d-804d-472226cdd4b1', '9668c70b-5aa1-4571-8ba2-d89e1b69db7b', '511a5e8c-2db5-4978-afa7-d179806e7f60', '40a059e8-5077-45de-86e9-09f2a3459898'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:57 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:27:57 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:57 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Deleted volume successfully. Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3519ea91-ed9f-4f7f-a300-14200c459c01 tempest-SnapshotsActionsTest-1977521213 None] Lock "cinder-b99165bf-5cbd-4ede-9172-22dda194f865-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:57 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:27:57 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:57 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.326s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Acquiring lock "cinder-c6850725-3861-4988-93a7-056ec4aad12a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Lock "cinder-c6850725-3861-4988-93a7-056ec4aad12a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Acquiring lock "cinder-quobyte-c6850725-3861-4988-93a7-056ec4aad12a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Lock "cinder-quobyte-c6850725-3861-4988-93a7-056ec4aad12a" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f14c52-a645-4255-812c-bb10a40eb7f6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:58 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a Nov 05 22:27:58 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:58 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a" returned: 0 in 0.384s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:58 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a Nov 05 22:27:58 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:58 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-c6850725-3861-4988-93a7-056ec4aad12a" returned: 0 in 0.271s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Lock "cinder-quobyte-c6850725-3861-4988-93a7-056ec4aad12a" released by "delete_volume" :: held 0.705s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Created reservations ['13aa7066-c58f-4bb4-a680-bc8e08673939', '1bfe94e9-294a-4689-920a-750f733e14e5', '95cd1afc-1511-401a-a365-1b4969a6c672', '7c769d96-a2c1-4a71-83e6-aaac87081403'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:58 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:27:58 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:59 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:59 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Deleted volume successfully. Nov 05 22:27:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-205aff3d-482c-4ac4-b066-e69e2e20af30 tempest-TestMinimumBasicScenario-964497226 None] Lock "cinder-c6850725-3861-4988-93a7-056ec4aad12a-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:08 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=90,cinder:UPDATE=93,cinder:DELETE=8,cinder:INSERT=32 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=109,cinder:UPDATE=111,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Flow 'volume_create_manager' (c648d77e-b835-4d3a-a967-16e352f79ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19dad99-5924-415b-9da8-d86cc17c9df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19dad99-5924-415b-9da8-d86cc17c9df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-405955426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9149a9ce-9a59-4fe0-963d-90374792331a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6caefb7bf4f58b9ffee5bc1b70c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:09Z,use_quota=True,user_id='ce154a3d776742c8a48bf9d2da95effc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e582b76-62b3-4c6c-a09f-9a60abde34d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e582b76-62b3-4c6c-a09f-9a60abde34d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874361cc-d505-44f1-afe7-25434303d130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874361cc-d505-44f1-afe7-25434303d130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9149a9ce-9a59-4fe0-963d-90374792331a', 'volume_name': 'volume-9149a9ce-9a59-4fe0-963d-90374792331a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77776500-08a5-4ce3-a9e5-e050a10324ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77776500-08a5-4ce3-a9e5-e050a10324ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420618a8-1c19-4246-a03b-e5ec553efa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:09 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Volume 9149a9ce-9a59-4fe0-963d-90374792331a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9149a9ce-9a59-4fe0-963d-90374792331a', 'volume_size': 1} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-405955426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9149a9ce-9a59-4fe0-963d-90374792331a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6caefb7bf4f58b9ffee5bc1b70c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:09Z,use_quota=True,user_id='ce154a3d776742c8a48bf9d2da95effc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Creating volume 9149a9ce-9a59-4fe0-963d-90374792331a {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:09 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:09 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a 1073741824 Nov 05 22:28:09 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:10 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a 1073741824" returned: 0 in 0.547s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:10 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a Nov 05 22:28:10 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:10 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a" returned: 0 in 0.295s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420618a8-1c19-4246-a03b-e5ec553efa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9149a9ce-9a59-4fe0-963d-90374792331a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f042649c-b98d-4f4d-89a4-360eef3778ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:10 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Volume volume-9149a9ce-9a59-4fe0-963d-90374792331a (9149a9ce-9a59-4fe0-963d-90374792331a): created successfully Nov 05 22:28:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f042649c-b98d-4f4d-89a4-360eef3778ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:10 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Flow 'volume_create_manager' (c648d77e-b835-4d3a-a967-16e352f79ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-94080dda-8851-41eb-a030-4333362a486b tempest-VolumesTransfersV355Test-196243518 None] Created volume successfully. Nov 05 22:28:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-248cfe29-858b-418d-8677-fa69d3171170 tempest-VolumesTransfersV355Test-1800290170 None] Transfer volume completed successfully. Nov 05 22:28:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Acquiring lock "cinder-9149a9ce-9a59-4fe0-963d-90374792331a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Lock "cinder-9149a9ce-9a59-4fe0-963d-90374792331a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Acquiring lock "cinder-quobyte-9149a9ce-9a59-4fe0-963d-90374792331a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Lock "cinder-quobyte-9149a9ce-9a59-4fe0-963d-90374792331a" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b311ae-4eb2-4f83-824e-74d6347e64c6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:13 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a Nov 05 22:28:13 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:13 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:13 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a Nov 05 22:28:13 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:14 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9149a9ce-9a59-4fe0-963d-90374792331a" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Lock "cinder-quobyte-9149a9ce-9a59-4fe0-963d-90374792331a" released by "delete_volume" :: held 0.671s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Created reservations ['55ac5533-abc5-40ff-8ebb-aee2a903a2fd', '07c06b53-2f22-4be9-8495-9fd0d1f557de', 'd8f9bb9f-ad1a-4585-88b0-bb348ee0feb1', 'a7f7405d-bef3-4269-800a-8bd071d0d22b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:14 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:14 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:14 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Deleted volume successfully. Nov 05 22:28:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2d5f4421-9240-4904-9b89-e449799d4b2b tempest-VolumesTransfersV355Test-669746234 None] Lock "cinder-9149a9ce-9a59-4fe0-963d-90374792331a-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Flow 'volume_create_manager' (cce1da3a-65e0-4bcc-8d5e-9bd9bda89ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87a68b1-0ac7-4a3b-b70a-72cc458dd13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87a68b1-0ac7-4a3b-b70a-72cc458dd13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1197162805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a6f6b0-354a-4573-846c-a10989155149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6caefb7bf4f58b9ffee5bc1b70c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:15Z,use_quota=True,user_id='ce154a3d776742c8a48bf9d2da95effc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827c13a2-f081-4a96-bd20-809037944173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827c13a2-f081-4a96-bd20-809037944173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8554a1d-57bf-46ce-8de3-976b282ef56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8554a1d-57bf-46ce-8de3-976b282ef56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a6f6b0-354a-4573-846c-a10989155149', 'volume_name': 'volume-10a6f6b0-354a-4573-846c-a10989155149', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201ea8d0-1565-4f40-a6cd-90ef610735dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201ea8d0-1565-4f40-a6cd-90ef610735dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25442aee-134b-425d-b63f-1d9d7af9df51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Volume 10a6f6b0-354a-4573-846c-a10989155149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a6f6b0-354a-4573-846c-a10989155149', 'volume_size': 1} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1197162805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a6f6b0-354a-4573-846c-a10989155149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6caefb7bf4f58b9ffee5bc1b70c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:15Z,use_quota=True,user_id='ce154a3d776742c8a48bf9d2da95effc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Creating volume 10a6f6b0-354a-4573-846c-a10989155149 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:15 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:15 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149 1073741824 Nov 05 22:28:15 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:15 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149 1073741824" returned: 0 in 0.429s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:15 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149 Nov 05 22:28:15 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:15 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25442aee-134b-425d-b63f-1d9d7af9df51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a6f6b0-354a-4573-846c-a10989155149', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af77830-85ce-4c23-bda6-5eb771f5cc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Volume volume-10a6f6b0-354a-4573-846c-a10989155149 (10a6f6b0-354a-4573-846c-a10989155149): created successfully Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af77830-85ce-4c23-bda6-5eb771f5cc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Flow 'volume_create_manager' (cce1da3a-65e0-4bcc-8d5e-9bd9bda89ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-682c5a58-9845-4447-b030-a7326d14528a tempest-VolumesTransfersV355Test-196243518 None] Created volume successfully. Nov 05 22:28:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Acquiring lock "cinder-10a6f6b0-354a-4573-846c-a10989155149-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Lock "cinder-10a6f6b0-354a-4573-846c-a10989155149-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Acquiring lock "cinder-quobyte-10a6f6b0-354a-4573-846c-a10989155149" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Lock "cinder-quobyte-10a6f6b0-354a-4573-846c-a10989155149" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6ea7a1-7ea5-4f91-9fcd-063099068beb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:16 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149 Nov 05 22:28:16 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:16 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149" returned: 0 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:16 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149 Nov 05 22:28:16 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:17 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-10a6f6b0-354a-4573-846c-a10989155149" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Lock "cinder-quobyte-10a6f6b0-354a-4573-846c-a10989155149" released by "delete_volume" :: held 0.676s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Created reservations ['ee6c114e-301a-4f79-9b88-28e96cdec19c', 'f4d3e3a0-2302-4f56-93be-00a80afb6746', '34f854e6-d37a-4a99-859e-4c6f3eea6553', 'c509f02d-21df-462d-a59d-35364d2e4d79'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:17 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:17 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:17 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Deleted volume successfully. Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d4e56ae9-8257-4b30-8fca-8dbc66cfa114 tempest-VolumesTransfersV355Test-669746234 None] Lock "cinder-10a6f6b0-354a-4573-846c-a10989155149-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Flow 'volume_create_manager' (fe859699-6733-4845-a393-48651f564b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9844d09e-79de-4ab0-8f91-112e6f2ad437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9844d09e-79de-4ab0-8f91-112e6f2ad437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f73009-54c3-46d6-80ed-597009af1c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c526958b031419bba9ec360dffc9d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:18Z,use_quota=True,user_id='8cd9eb2f6e464b16a6c4e9caf1aee3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0235828-9fdf-4703-a687-c9b1a601f25e),volume_type_id=e0235828-9fdf-4703-a687-c9b1a601f25e)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af4c766-9174-42f8-ac11-f03f09ee4403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af4c766-9174-42f8-ac11-f03f09ee4403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d01b09-b885-4555-bc8d-a10cae36783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:17 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d01b09-b885-4555-bc8d-a10cae36783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2f73009-54c3-46d6-80ed-597009af1c68', 'volume_name': 'volume-a2f73009-54c3-46d6-80ed-597009af1c68', 'volume_size': 1, 'image_id': '5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa8be61e50e55da8962b52890b08f6ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c526958b031419bba9ec360dffc9d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '363be8a75178ff522a7be7d458893daba058de8a0db6993f5cc33a18d0ab1c53b785069b3a10e6b16cd61046f057574cda250fde9afe83476048ce6bc5b329dd', 'id': '5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'created_at': datetime.datetime(2026, 11, 5, 21, 28, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 28, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62928cfd-d4f7-47bf-8aff-5d7b5543da09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62928cfd-d4f7-47bf-8aff-5d7b5543da09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c91bec-9f3a-404a-8c52-69894bdb20da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:18 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Volume a2f73009-54c3-46d6-80ed-597009af1c68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2f73009-54c3-46d6-80ed-597009af1c68', 'volume_size': 1, 'image_id': '5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa8be61e50e55da8962b52890b08f6ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c526958b031419bba9ec360dffc9d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '363be8a75178ff522a7be7d458893daba058de8a0db6993f5cc33a18d0ab1c53b785069b3a10e6b16cd61046f057574cda250fde9afe83476048ce6bc5b329dd', 'id': '5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'created_at': datetime.datetime(2026, 11, 5, 21, 28, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 28, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Trying to clone a2f73009-54c3-46d6-80ed-597009af1c68 from image 5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:28:18 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Image download 0.00 MB at 0.00 MB/s Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b0b48e-1825-4e4a-9eb5-102770ad258a]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:18 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD Nov 05 22:28:18 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:18 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:18 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD Nov 05 22:28:18 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:18 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:28:18 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Temporary image 5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969 is fetched for user 8cd9eb2f6e464b16a6c4e9caf1aee3c1. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e7a077-e9ab-4a4f-a34a-89baa27b85d1]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:19 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD Nov 05 22:28:19 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:19 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:19 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD Nov 05 22:28:19 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:19 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f73009-54c3-46d6-80ed-597009af1c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c526958b031419bba9ec360dffc9d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:18Z,use_quota=True,user_id='8cd9eb2f6e464b16a6c4e9caf1aee3c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0235828-9fdf-4703-a687-c9b1a601f25e),volume_type_id=e0235828-9fdf-4703-a687-c9b1a601f25e)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Creating volume a2f73009-54c3-46d6-80ed-597009af1c68 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:19 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:19 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 1073741824 Nov 05 22:28:19 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:20 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 1073741824" returned: 0 in 0.479s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:20 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 Nov 05 22:28:20 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:20 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:20 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Attempting download of 5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969 ((None, [{'url': 'file:///opt/stack/data/glance/images/5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'metadata': {}}])) to volume a2f73009-54c3-46d6-80ed-597009af1c68. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:28:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd7380b-dbcb-424b-9b0b-b9ac3c554c0f]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_7iaih14b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:20 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_7iaih14b Nov 05 22:28:20 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:21 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_7iaih14b" returned: 0 in 0.360s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_7iaih14b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:21 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_7iaih14b Nov 05 22:28:21 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:21 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_7iaih14b" returned: 1 in 0.348s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_7iaih14b' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:28:21 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a14ab81-e052-47db-a2b2-b07fe73350de]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:21 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD Nov 05 22:28:21 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:21 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:21 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD Nov 05 22:28:21 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:22 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] 5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969 was raw, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:22 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 Nov 05 22:28:22 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:22 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68" returned: 0 in 0.478s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969_b4edhkw0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:28:22 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:22 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 1G Nov 05 22:28:22 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:22 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 1G" returned: 0 in 0.336s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Downloaded image 5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969 ((None, [{'url': 'file:///opt/stack/data/glance/images/5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'metadata': {}}])) to volume a2f73009-54c3-46d6-80ed-597009af1c68 successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Temporary image 5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969 for user 8cd9eb2f6e464b16a6c4e9caf1aee3c1 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Marking volume a2f73009-54c3-46d6-80ed-597009af1c68 as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Copying metadata from image 5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969 to a2f73009-54c3-46d6-80ed-597009af1c68. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:28:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Creating volume glance metadata for volume a2f73009-54c3-46d6-80ed-597009af1c68 backed by image 5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'aa8be61e50e55da8962b52890b08f6ff', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:28:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c91bec-9f3a-404a-8c52-69894bdb20da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f73009-54c3-46d6-80ed-597009af1c68', 'volume_size': 1, 'image_id': '5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa8be61e50e55da8962b52890b08f6ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7c526958b031419bba9ec360dffc9d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '363be8a75178ff522a7be7d458893daba058de8a0db6993f5cc33a18d0ab1c53b785069b3a10e6b16cd61046f057574cda250fde9afe83476048ce6bc5b329dd', 'id': '5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969', 'created_at': datetime.datetime(2026, 11, 5, 21, 28, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 28, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5378fc9f-f7fe-4cd6-8d6d-a36f12b6a969/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c994cc4-9132-4d4a-9d67-179d514d8de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Volume volume-a2f73009-54c3-46d6-80ed-597009af1c68 (a2f73009-54c3-46d6-80ed-597009af1c68): created successfully Nov 05 22:28:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c994cc4-9132-4d4a-9d67-179d514d8de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Flow 'volume_create_manager' (fe859699-6733-4845-a393-48651f564b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7476eb22-e077-4975-9c13-7e5e42d0f44a tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Created volume successfully. Nov 05 22:28:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Acquiring lock "cinder-a2f73009-54c3-46d6-80ed-597009af1c68-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Lock "cinder-a2f73009-54c3-46d6-80ed-597009af1c68-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Acquiring lock "cinder-quobyte-a2f73009-54c3-46d6-80ed-597009af1c68" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Lock "cinder-quobyte-a2f73009-54c3-46d6-80ed-597009af1c68" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[559e298a-595f-4c21-bd7b-6430b546351a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:24 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 Nov 05 22:28:24 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:24 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68" returned: 0 in 0.373s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:24 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68 Nov 05 22:28:24 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:24 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a2f73009-54c3-46d6-80ed-597009af1c68" returned: 0 in 0.249s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Lock "cinder-quobyte-a2f73009-54c3-46d6-80ed-597009af1c68" released by "delete_volume" :: held 0.670s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:24 devstack cinder-volume[87122]: WARNING cinder.quota [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:28:24 devstack cinder-volume[87122]: WARNING cinder.quota [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Created reservations ['1c1f0ad2-7994-4e0c-9043-8a51551db4d0', '576645cf-6c1f-4cce-9128-a1ebeb44d76f', '0696eecd-342a-43d0-bfb6-28c5ee485655', 'a38d7005-e1a7-4072-94eb-38fe3f7a234d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:24 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:24 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Flow 'volume_create_manager' (dadf0301-cd05-405e-b2d7-2c31c98f5e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f075c896-27b3-412f-87a3-559c1b5f8471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f075c896-27b3-412f-87a3-559c1b5f8471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1060900137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd629788-359a-4f6f-afbb-fdd9b6bf2df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7ef347b02447a4989dab941ccdaca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:25Z,use_quota=True,user_id='fdd030836b5d4a6fbf5d010cc17f020f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4712bdca-abe6-406f-ac0b-b4f4b1795de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4712bdca-abe6-406f-ac0b-b4f4b1795de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9675669e-523d-4652-a83d-86e881a506cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:25 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9675669e-523d-4652-a83d-86e881a506cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd629788-359a-4f6f-afbb-fdd9b6bf2df4', 'volume_name': 'volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928bcbf2-10e7-435d-9ec3-2ec2ee86ca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928bcbf2-10e7-435d-9ec3-2ec2ee86ca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f77874c-b46d-49d0-8163-8c578a82653a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Volume fd629788-359a-4f6f-afbb-fdd9b6bf2df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4', 'volume_size': 1} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1060900137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd629788-359a-4f6f-afbb-fdd9b6bf2df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7ef347b02447a4989dab941ccdaca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:25Z,use_quota=True,user_id='fdd030836b5d4a6fbf5d010cc17f020f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Creating volume fd629788-359a-4f6f-afbb-fdd9b6bf2df4 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:25 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Deleted volume successfully. Nov 05 22:28:25 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4 1073741824 Nov 05 22:28:25 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0df40880-9b05-4bf7-b9d9-420ced2211aa tempest-VolumeAndVolumeTypeFromImageTest-1058561018 None] Lock "cinder-a2f73009-54c3-46d6-80ed-597009af1c68-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:25 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4 1073741824" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:25 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4 Nov 05 22:28:25 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:25 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4" returned: 0 in 0.271s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f77874c-b46d-49d0-8163-8c578a82653a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d172d208-3b57-4e87-92cf-319a0bb50a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Volume volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4 (fd629788-359a-4f6f-afbb-fdd9b6bf2df4): created successfully Nov 05 22:28:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d172d208-3b57-4e87-92cf-319a0bb50a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Flow 'volume_create_manager' (dadf0301-cd05-405e-b2d7-2c31c98f5e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-44b33967-de22-4f67-b13d-0f2463b57147 tempest-VolumesTransfersV357Test-537277409 None] Created volume successfully. Nov 05 22:28:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0d957583-1694-496d-ba46-f4c9c12598a6 tempest-VolumesTransfersV357Test-1622922794 None] Transfer volume completed successfully. Nov 05 22:28:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Acquiring lock "cinder-fd629788-359a-4f6f-afbb-fdd9b6bf2df4-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Lock "cinder-fd629788-359a-4f6f-afbb-fdd9b6bf2df4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Acquiring lock "cinder-quobyte-fd629788-359a-4f6f-afbb-fdd9b6bf2df4" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Lock "cinder-quobyte-fd629788-359a-4f6f-afbb-fdd9b6bf2df4" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:28 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab33c14-b6e8-45ff-a3d1-857d4a530428]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:28 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4 Nov 05 22:28:28 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:29 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:29 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4 Nov 05 22:28:29 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:29 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fd629788-359a-4f6f-afbb-fdd9b6bf2df4" returned: 0 in 0.270s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Lock "cinder-quobyte-fd629788-359a-4f6f-afbb-fdd9b6bf2df4" released by "delete_volume" :: held 0.691s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Created reservations ['128b89b8-0171-4cc1-a50e-b7a483718ce4', '9b666d82-5b03-4b1c-9cca-78200f666bf9', '61afcd81-d331-4785-ac32-ecca0dde13c7', '419685b3-a357-413f-8dac-b1d448d09897'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:29 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:29 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:29 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Deleted volume successfully. Nov 05 22:28:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ee0f86d2-4eee-49dd-bb2e-98814c7746e9 tempest-VolumesTransfersV357Test-1605858955 None] Lock "cinder-fd629788-359a-4f6f-afbb-fdd9b6bf2df4-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Flow 'volume_create_manager' (77e3c67a-496b-4e03-be23-a0ebceebd39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2a1e58-3419-408d-b9cc-3f3b26265571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2a1e58-3419-408d-b9cc-3f3b26265571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1550789524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07baae6-f6a7-4c69-a3f7-ff920f9380a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f46894920a049c1b9516f8477124f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:30Z,use_quota=True,user_id='ffec52300145456f858096b276ad1bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25397e50-008a-470e-918b-be353b0e634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25397e50-008a-470e-918b-be353b0e634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0894b28e-c1c8-4ccf-9baa-3053b66bcfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0894b28e-c1c8-4ccf-9baa-3053b66bcfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a07baae6-f6a7-4c69-a3f7-ff920f9380a5', 'volume_name': 'volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211c654e-28e6-4a97-9526-bd9cac9085b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211c654e-28e6-4a97-9526-bd9cac9085b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60396c6-d734-43bd-8c9c-f1b431f18269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Volume a07baae6-f6a7-4c69-a3f7-ff920f9380a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5', 'volume_size': 1} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1550789524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07baae6-f6a7-4c69-a3f7-ff920f9380a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f46894920a049c1b9516f8477124f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:30Z,use_quota=True,user_id='ffec52300145456f858096b276ad1bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Creating volume a07baae6-f6a7-4c69-a3f7-ff920f9380a5 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:30 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:30 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5 1073741824 Nov 05 22:28:30 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Flow 'volume_create_manager' (17521db2-0da2-482e-89a6-3f733e2968fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b158b782-abd3-4d70-99fe-0f0ac73bd23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b158b782-abd3-4d70-99fe-0f0ac73bd23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1657004457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74df9f6e-166c-4832-b3f2-fc230e558182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7ef347b02447a4989dab941ccdaca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:30Z,use_quota=True,user_id='fdd030836b5d4a6fbf5d010cc17f020f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6b6d0d-8030-4780-8294-3ab13d698045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6b6d0d-8030-4780-8294-3ab13d698045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a018c197-ac21-4b60-9606-9d30eab7dce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a018c197-ac21-4b60-9606-9d30eab7dce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74df9f6e-166c-4832-b3f2-fc230e558182', 'volume_name': 'volume-74df9f6e-166c-4832-b3f2-fc230e558182', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb563e4-9473-40f9-8bf9-1d8aee5d9db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb563e4-9473-40f9-8bf9-1d8aee5d9db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d274e60-44d8-48e7-9751-f59a05b4d86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Volume 74df9f6e-166c-4832-b3f2-fc230e558182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74df9f6e-166c-4832-b3f2-fc230e558182', 'volume_size': 1} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:30 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5 1073741824" returned: 0 in 0.444s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:30 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5 Nov 05 22:28:30 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:30 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1657004457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74df9f6e-166c-4832-b3f2-fc230e558182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7ef347b02447a4989dab941ccdaca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:30Z,use_quota=True,user_id='fdd030836b5d4a6fbf5d010cc17f020f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Creating volume 74df9f6e-166c-4832-b3f2-fc230e558182 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:30 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60396c6-d734-43bd-8c9c-f1b431f18269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:31 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182 1073741824 Nov 05 22:28:31 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59d099d-0c65-4672-a225-d4b05647d6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Volume volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5 (a07baae6-f6a7-4c69-a3f7-ff920f9380a5): created successfully Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59d099d-0c65-4672-a225-d4b05647d6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Flow 'volume_create_manager' (77e3c67a-496b-4e03-be23-a0ebceebd39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fec94ff4-b711-4f8a-a9ba-9820c2b1b6f7 tempest-ProjectReaderTests-889553346 None] Created volume successfully. Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Acquiring lock "cinder-a07baae6-f6a7-4c69-a3f7-ff920f9380a5-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Lock "cinder-a07baae6-f6a7-4c69-a3f7-ff920f9380a5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Acquiring lock "cinder-quobyte-a07baae6-f6a7-4c69-a3f7-ff920f9380a5" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Lock "cinder-quobyte-a07baae6-f6a7-4c69-a3f7-ff920f9380a5" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a82ab3e-0359-42fe-9274-fb743ed12cc9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:31 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182 1073741824" returned: 0 in 0.498s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:31 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5 Nov 05 22:28:31 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:31 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182 Nov 05 22:28:31 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:31 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:31 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d274e60-44d8-48e7-9751-f59a05b4d86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74df9f6e-166c-4832-b3f2-fc230e558182', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5710924-5e8c-4bfa-9d5b-6a4759793907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:31 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5 Nov 05 22:28:31 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Volume volume-74df9f6e-166c-4832-b3f2-fc230e558182 (74df9f6e-166c-4832-b3f2-fc230e558182): created successfully Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5710924-5e8c-4bfa-9d5b-6a4759793907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Flow 'volume_create_manager' (17521db2-0da2-482e-89a6-3f733e2968fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-86200441-5ad2-4638-86f7-9507325bbd8f tempest-VolumesTransfersV357Test-537277409 None] Created volume successfully. Nov 05 22:28:32 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a07baae6-f6a7-4c69-a3f7-ff920f9380a5" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Lock "cinder-quobyte-a07baae6-f6a7-4c69-a3f7-ff920f9380a5" released by "delete_volume" :: held 0.682s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Created reservations ['a2592c33-e8e3-49e2-87eb-8795837bca10', '1177bd12-d3bb-488a-b4e9-6460458a32f9', '10c927c9-845d-4efc-a6b4-c871a99c4ac3', 'b41bb222-06b1-42ab-a336-9d0509579b5d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:32 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:32 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:32 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Deleted volume successfully. Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6ebf51-c87c-466d-8122-964b0d70ced1 tempest-ProjectReaderTests-889553346 None] Lock "cinder-a07baae6-f6a7-4c69-a3f7-ff920f9380a5-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Acquiring lock "cinder-74df9f6e-166c-4832-b3f2-fc230e558182-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Lock "cinder-74df9f6e-166c-4832-b3f2-fc230e558182-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Acquiring lock "cinder-quobyte-74df9f6e-166c-4832-b3f2-fc230e558182" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Lock "cinder-quobyte-74df9f6e-166c-4832-b3f2-fc230e558182" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d3c424-80e3-4ff5-9f2d-931521986600]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Flow 'volume_create_manager' (d0182e93-8236-4feb-8bbc-b9d871f9cca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b3ebd2-c912-4898-8f0e-da61106cb6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:33 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182 Nov 05 22:28:33 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b3ebd2-c912-4898-8f0e-da61106cb6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028177769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bc8cfa-975f-430a-a495-a7be628aefd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f46894920a049c1b9516f8477124f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:33Z,use_quota=True,user_id='ffec52300145456f858096b276ad1bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2975ff-6efe-4a52-a76c-1c8701c0cd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2975ff-6efe-4a52-a76c-1c8701c0cd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d8ca6b-bbb4-45cb-bdc6-269de1bd165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d8ca6b-bbb4-45cb-bdc6-269de1bd165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3bc8cfa-975f-430a-a495-a7be628aefd9', 'volume_name': 'volume-e3bc8cfa-975f-430a-a495-a7be628aefd9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393f48a3-de54-43e8-8021-f6a0275a06db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393f48a3-de54-43e8-8021-f6a0275a06db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178a8166-cb4c-460f-9d81-33acc9f52551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Volume e3bc8cfa-975f-430a-a495-a7be628aefd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3bc8cfa-975f-430a-a495-a7be628aefd9', 'volume_size': 1} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028177769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bc8cfa-975f-430a-a495-a7be628aefd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f46894920a049c1b9516f8477124f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:33Z,use_quota=True,user_id='ffec52300145456f858096b276ad1bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Creating volume e3bc8cfa-975f-430a-a495-a7be628aefd9 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:33 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:33 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9 1073741824 Nov 05 22:28:33 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:33 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:33 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182 Nov 05 22:28:33 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:33 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9 1073741824" returned: 0 in 0.412s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:33 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74df9f6e-166c-4832-b3f2-fc230e558182" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:33 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9 Nov 05 22:28:33 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Lock "cinder-quobyte-74df9f6e-166c-4832-b3f2-fc230e558182" released by "delete_volume" :: held 0.696s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Created reservations ['00e65615-52e2-4119-8dd7-a8f668e238b8', '7d73324f-bd18-409a-8890-84c9e4760438', '30745def-ea8c-41ce-8853-25ce5e8cbedc', '08b9ba4f-ffd0-4e6c-b4d7-308864f7f532'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:33 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:33 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:33 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9" returned: 0 in 0.259s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178a8166-cb4c-460f-9d81-33acc9f52551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3bc8cfa-975f-430a-a495-a7be628aefd9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120e775b-9a7f-4ef3-b6b1-02fc3aa103a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Volume volume-e3bc8cfa-975f-430a-a495-a7be628aefd9 (e3bc8cfa-975f-430a-a495-a7be628aefd9): created successfully Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120e775b-9a7f-4ef3-b6b1-02fc3aa103a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Flow 'volume_create_manager' (d0182e93-8236-4feb-8bbc-b9d871f9cca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-23f07b74-8ba1-41ac-9211-6b40aab406b5 tempest-ProjectReaderTests-889553346 None] Created volume successfully. Nov 05 22:28:33 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Deleted volume successfully. Nov 05 22:28:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4c4eb70-f74a-41c5-83c2-a55345441679 tempest-VolumesTransfersV357Test-1605858955 None] Lock "cinder-74df9f6e-166c-4832-b3f2-fc230e558182-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Acquiring lock "cinder-e3bc8cfa-975f-430a-a495-a7be628aefd9-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Lock "cinder-e3bc8cfa-975f-430a-a495-a7be628aefd9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Acquiring lock "cinder-quobyte-e3bc8cfa-975f-430a-a495-a7be628aefd9" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Lock "cinder-quobyte-e3bc8cfa-975f-430a-a495-a7be628aefd9" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f7b36c-6d4f-4514-95d0-b2dff3cb4c3b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:34 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9 Nov 05 22:28:34 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:34 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:34 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9 Nov 05 22:28:34 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:34 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e3bc8cfa-975f-430a-a495-a7be628aefd9" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Lock "cinder-quobyte-e3bc8cfa-975f-430a-a495-a7be628aefd9" released by "delete_volume" :: held 0.675s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Created reservations ['9db687cc-9d76-476f-9e32-891159434228', 'cbcf0492-08d9-4d21-9a2d-8fff80c1c540', '1088a8b8-4c4d-489c-b419-3d0853d8d6ae', '842c42e3-8984-439d-a311-521b31b0bf09'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:34 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:34 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:35 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:35 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Deleted volume successfully. Nov 05 22:28:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-054708d3-3dab-4fa3-8f10-f1a9cda89b4d tempest-ProjectReaderTests-889553346 None] Lock "cinder-e3bc8cfa-975f-430a-a495-a7be628aefd9-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Flow 'volume_create_manager' (18a7156f-c903-4cc2-b636-5a5fad91f244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a63a2ce-3f01-487a-b551-c9027d16d301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a63a2ce-3f01-487a-b551-c9027d16d301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232407966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21552aa5-26af-4817-b41c-7d440504b3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d342e859b55e496fbd3554eab72d1baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:39Z,use_quota=True,user_id='3c6f9f7804924c0d95ed674c40611427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8688aa4-3897-4371-8f9a-bbab8446435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8688aa4-3897-4371-8f9a-bbab8446435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32cd26c-50e3-4ab2-94a5-6e11c855f859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32cd26c-50e3-4ab2-94a5-6e11c855f859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21552aa5-26af-4817-b41c-7d440504b3dc', 'volume_name': 'volume-21552aa5-26af-4817-b41c-7d440504b3dc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1935424a-7fdd-41f4-b754-05aa4cae1f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1935424a-7fdd-41f4-b754-05aa4cae1f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e7f8d4-0a27-4a1b-b366-edfca3fb8e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Volume 21552aa5-26af-4817-b41c-7d440504b3dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21552aa5-26af-4817-b41c-7d440504b3dc', 'volume_size': 1} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232407966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21552aa5-26af-4817-b41c-7d440504b3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d342e859b55e496fbd3554eab72d1baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:39Z,use_quota=True,user_id='3c6f9f7804924c0d95ed674c40611427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Creating volume 21552aa5-26af-4817-b41c-7d440504b3dc {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:39 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc 1073741824 Nov 05 22:28:39 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:39 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc 1073741824" returned: 0 in 0.445s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:39 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc Nov 05 22:28:39 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:40 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e7f8d4-0a27-4a1b-b366-edfca3fb8e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21552aa5-26af-4817-b41c-7d440504b3dc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e4ac5d-4ebf-4b93-b6dc-0f75ddc0da54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Volume volume-21552aa5-26af-4817-b41c-7d440504b3dc (21552aa5-26af-4817-b41c-7d440504b3dc): created successfully Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e4ac5d-4ebf-4b93-b6dc-0f75ddc0da54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Flow 'volume_create_manager' (18a7156f-c903-4cc2-b636-5a5fad91f244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-498921a0-cdb3-4db3-b450-28639b290969 tempest-ProjectReaderTests-471772236 None] Created volume successfully. Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Flow 'volume_create_manager' (ad80a4ef-3675-4b4c-a56f-6239705d4342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e978cb83-eb78-4082-835d-4eaac4044254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Acquiring lock "cinder-21552aa5-26af-4817-b41c-7d440504b3dc-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e978cb83-eb78-4082-835d-4eaac4044254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1303193834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97026b9f-fbef-4271-b439-d075a662eb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d41f631fb949e38f90fcdcd872fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:40Z,use_quota=True,user_id='db1cb955485c48e2878864131dfd2736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272f887d-116b-46a9-87ee-af980ae8087f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272f887d-116b-46a9-87ee-af980ae8087f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97deec34-7482-4f2c-9512-39fa13e5780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97deec34-7482-4f2c-9512-39fa13e5780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97026b9f-fbef-4271-b439-d075a662eb76', 'volume_name': 'volume-97026b9f-fbef-4271-b439-d075a662eb76', 'volume_size': 2}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e506ec-abe5-404a-9c76-fca84f017542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e506ec-abe5-404a-9c76-fca84f017542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dfc2233-9167-4e33-aacd-e3490872326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Volume 97026b9f-fbef-4271-b439-d075a662eb76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97026b9f-fbef-4271-b439-d075a662eb76', 'volume_size': 2} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1303193834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97026b9f-fbef-4271-b439-d075a662eb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d41f631fb949e38f90fcdcd872fab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:40Z,use_quota=True,user_id='db1cb955485c48e2878864131dfd2736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Creating volume 97026b9f-fbef-4271-b439-d075a662eb76 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:40 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76 2147483648 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Lock "cinder-21552aa5-26af-4817-b41c-7d440504b3dc-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:40 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76 2147483648 Nov 05 22:28:40 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Acquiring lock "cinder-quobyte-21552aa5-26af-4817-b41c-7d440504b3dc" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Lock "cinder-quobyte-21552aa5-26af-4817-b41c-7d440504b3dc" acquired by "delete_volume" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10f569a-8cbb-4cef-825f-e291e19b25b2]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:40 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc Nov 05 22:28:40 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:41 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76 2147483648" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:41 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc" returned: 0 in 0.379s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:41 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc Nov 05 22:28:41 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:41 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76 Nov 05 22:28:41 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:41 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21552aa5-26af-4817-b41c-7d440504b3dc" returned: 0 in 0.243s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Lock "cinder-quobyte-21552aa5-26af-4817-b41c-7d440504b3dc" released by "delete_volume" :: held 0.669s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:41 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dfc2233-9167-4e33-aacd-e3490872326b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97026b9f-fbef-4271-b439-d075a662eb76', 'volume_size': 2}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3343be3e-80d6-4c08-8514-e9272d658367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Volume volume-97026b9f-fbef-4271-b439-d075a662eb76 (97026b9f-fbef-4271-b439-d075a662eb76): created successfully Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3343be3e-80d6-4c08-8514-e9272d658367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Flow 'volume_create_manager' (ad80a4ef-3675-4b4c-a56f-6239705d4342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f154378a-e5af-42c8-82ad-7ac2bd8b4fd9 tempest-VolumesCloneNegativeTest-1325628560 None] Created volume successfully. Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Created reservations ['f2b56708-69b0-40f9-9e11-90f76ad9e6f6', 'cde4e065-4e1b-4d4e-9b2e-f6cdb68f2a55', '4dd5f1f6-7e94-4a4d-bf71-70f85c6980a6', '9d239a1e-cbd2-46f7-a557-bf951a3ff68e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:41 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:41 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Acquiring lock "cinder-97026b9f-fbef-4271-b439-d075a662eb76-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Lock "cinder-97026b9f-fbef-4271-b439-d075a662eb76-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Acquiring lock "cinder-quobyte-97026b9f-fbef-4271-b439-d075a662eb76" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:41 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.310s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Lock "cinder-quobyte-97026b9f-fbef-4271-b439-d075a662eb76" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Deleted volume successfully. Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0953da-7f65-4036-b0fc-b0a350820fd3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e05cd695-e62c-41c4-882e-ac7dc679331c tempest-ProjectReaderTests-471772236 None] Lock "cinder-21552aa5-26af-4817-b41c-7d440504b3dc-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:41 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76 Nov 05 22:28:41 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Flow 'volume_create_manager' (523f31c9-fc27-468d-83ab-9a2625516914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddf2556-b7d3-4038-a2e4-3c65f79a23b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:42 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddf2556-b7d3-4038-a2e4-3c65f79a23b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-655905165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e40779-ced6-4da2-9ab7-a0af83c365ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d342e859b55e496fbd3554eab72d1baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:42Z,use_quota=True,user_id='3c6f9f7804924c0d95ed674c40611427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eceaa4e5-4f9c-48b2-b4d6-a7796e54bb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eceaa4e5-4f9c-48b2-b4d6-a7796e54bb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbb11dd-6b7d-4729-a98c-7dfe85d2d573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbb11dd-6b7d-4729-a98c-7dfe85d2d573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e40779-ced6-4da2-9ab7-a0af83c365ee', 'volume_name': 'volume-80e40779-ced6-4da2-9ab7-a0af83c365ee', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8dfbee-0573-46bf-8f8c-913a9a978ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8dfbee-0573-46bf-8f8c-913a9a978ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8762b6-a22f-4e6e-9118-da5904532ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Volume 80e40779-ced6-4da2-9ab7-a0af83c365ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e40779-ced6-4da2-9ab7-a0af83c365ee', 'volume_size': 1} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-655905165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e40779-ced6-4da2-9ab7-a0af83c365ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d342e859b55e496fbd3554eab72d1baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:42Z,use_quota=True,user_id='3c6f9f7804924c0d95ed674c40611427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Creating volume 80e40779-ced6-4da2-9ab7-a0af83c365ee {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:42 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76" returned: 0 in 0.454s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:42 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee 1073741824 Nov 05 22:28:42 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:42 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76 Nov 05 22:28:42 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:42 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97026b9f-fbef-4271-b439-d075a662eb76" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Lock "cinder-quobyte-97026b9f-fbef-4271-b439-d075a662eb76" released by "delete_volume" :: held 0.750s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Created reservations ['9c3f18ae-1eb4-45ce-9a6e-7901018bca0c', 'dfdb6e26-8924-424e-803e-94595a4cac32', '28bb4a99-10c2-49f1-9b6d-84fbe0ae37c0', '595d50fc-72f0-4dd5-8141-655804afa0a3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:42 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:42 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:42 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee 1073741824" returned: 0 in 0.433s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:42 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee Nov 05 22:28:42 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:42 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Deleted volume successfully. Nov 05 22:28:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dcdc2352-aa2f-4d2a-9ed5-7d45b8e60d06 tempest-VolumesCloneNegativeTest-1325628560 None] Lock "cinder-97026b9f-fbef-4271-b439-d075a662eb76-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:43 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8762b6-a22f-4e6e-9118-da5904532ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e40779-ced6-4da2-9ab7-a0af83c365ee', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01efa9ca-dc47-4ed7-aa68-317ce088ceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:43 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Volume volume-80e40779-ced6-4da2-9ab7-a0af83c365ee (80e40779-ced6-4da2-9ab7-a0af83c365ee): created successfully Nov 05 22:28:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01efa9ca-dc47-4ed7-aa68-317ce088ceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Flow 'volume_create_manager' (523f31c9-fc27-468d-83ab-9a2625516914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5383ca13-970d-4ee1-be03-e8ed96e7098d tempest-ProjectReaderTests-471772236 None] Created volume successfully. Nov 05 22:28:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Acquiring lock "cinder-80e40779-ced6-4da2-9ab7-a0af83c365ee-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Lock "cinder-80e40779-ced6-4da2-9ab7-a0af83c365ee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Acquiring lock "cinder-quobyte-80e40779-ced6-4da2-9ab7-a0af83c365ee" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Lock "cinder-quobyte-80e40779-ced6-4da2-9ab7-a0af83c365ee" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e621fe71-adb1-4af6-a3cb-26255af3b496]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:44 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee Nov 05 22:28:44 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:44 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee" returned: 0 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:44 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee Nov 05 22:28:44 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:45 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-80e40779-ced6-4da2-9ab7-a0af83c365ee" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Lock "cinder-quobyte-80e40779-ced6-4da2-9ab7-a0af83c365ee" released by "delete_volume" :: held 0.686s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Created reservations ['a6ec5f08-8be5-4dd0-bad7-6c7abfe7b5c5', '648c7625-56fb-4546-912b-f49a3f4d7776', '109959b7-ad52-4c88-9dd8-4b63404198b1', 'fef5dae9-0f9d-499d-b339-358dd5914882'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:45 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:45 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:45 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.260s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Deleted volume successfully. Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-24051fb9-8ff5-4b0c-99df-12bcdb952366 tempest-ProjectReaderTests-471772236 None] Lock "cinder-80e40779-ced6-4da2-9ab7-a0af83c365ee-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Flow 'volume_create_manager' (fe4cb677-d71d-450b-9156-082a70cdd4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58591b3-df77-4ab5-a073-8d657aefd085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58591b3-df77-4ab5-a073-8d657aefd085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-48102906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcdff61-f339-476c-8a2e-a303c04e274f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d342e859b55e496fbd3554eab72d1baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:46Z,use_quota=True,user_id='3c6f9f7804924c0d95ed674c40611427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837fd5b7-d7a5-4cef-9cac-9d65d546bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837fd5b7-d7a5-4cef-9cac-9d65d546bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fe5d91-c36d-43c3-a5c8-9ea9a6520443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fe5d91-c36d-43c3-a5c8-9ea9a6520443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcdff61-f339-476c-8a2e-a303c04e274f', 'volume_name': 'volume-6bcdff61-f339-476c-8a2e-a303c04e274f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f49dcf-207a-4401-9612-61698b6a7b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f49dcf-207a-4401-9612-61698b6a7b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0634cc4c-e5a9-417d-a799-51e25b1fc72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Volume 6bcdff61-f339-476c-8a2e-a303c04e274f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcdff61-f339-476c-8a2e-a303c04e274f', 'volume_size': 1} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-48102906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcdff61-f339-476c-8a2e-a303c04e274f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d342e859b55e496fbd3554eab72d1baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:46Z,use_quota=True,user_id='3c6f9f7804924c0d95ed674c40611427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Creating volume 6bcdff61-f339-476c-8a2e-a303c04e274f {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:46 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:46 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f 1073741824 Nov 05 22:28:46 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:46 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f 1073741824" returned: 0 in 0.486s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (0d5fe16a-c673-499a-b954-0d3332337175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cec0db-3154-421e-afd8-07ac8ee645c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cec0db-3154-421e-afd8-07ac8ee645c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-727819428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb725c8-f907-424d-bb73-68967fd331f4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:46Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4a6fdd-8d89-459d-b2d2-1e477b92e00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4a6fdd-8d89-459d-b2d2-1e477b92e00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee58a3d-f225-466a-a08e-5b370d4a0acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee58a3d-f225-466a-a08e-5b370d4a0acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb725c8-f907-424d-bb73-68967fd331f4', 'volume_name': 'volume-8bb725c8-f907-424d-bb73-68967fd331f4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ead261-92e3-4688-93ab-81d0f1f9b5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ead261-92e3-4688-93ab-81d0f1f9b5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee02f67b-7696-4848-94aa-2063024d3e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Volume 8bb725c8-f907-424d-bb73-68967fd331f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb725c8-f907-424d-bb73-68967fd331f4', 'volume_size': 1} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:46 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f Nov 05 22:28:46 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:46 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f" returned: 0 in 0.243s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.257s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-727819428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb725c8-f907-424d-bb73-68967fd331f4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:46Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Creating volume 8bb725c8-f907-424d-bb73-68967fd331f4 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:46 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0634cc4c-e5a9-417d-a799-51e25b1fc72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcdff61-f339-476c-8a2e-a303c04e274f', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:46 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4 1073741824 Nov 05 22:28:46 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d195d8-1a0d-4b28-b43a-33c7c479a3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Volume volume-6bcdff61-f339-476c-8a2e-a303c04e274f (6bcdff61-f339-476c-8a2e-a303c04e274f): created successfully Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d195d8-1a0d-4b28-b43a-33c7c479a3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Flow 'volume_create_manager' (fe4cb677-d71d-450b-9156-082a70cdd4d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-35c85af8-8a45-4332-b3c6-9c8262922ee5 tempest-ProjectReaderTests-471772236 None] Created volume successfully. Nov 05 22:28:47 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4 1073741824" returned: 0 in 0.409s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:47 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4 Nov 05 22:28:47 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:47 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4" returned: 0 in 0.238s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee02f67b-7696-4848-94aa-2063024d3e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb725c8-f907-424d-bb73-68967fd331f4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f2af0c-de6c-4a33-9ce4-2e6ee30b0d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Volume volume-8bb725c8-f907-424d-bb73-68967fd331f4 (8bb725c8-f907-424d-bb73-68967fd331f4): created successfully Nov 05 22:28:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f2af0c-de6c-4a33-9ce4-2e6ee30b0d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (0d5fe16a-c673-499a-b954-0d3332337175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-18265263-956f-4400-8f04-ce639767e991 tempest-VolumesGetTest-1845019465 None] Created volume successfully. Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Acquiring lock "cinder-6bcdff61-f339-476c-8a2e-a303c04e274f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Lock "cinder-6bcdff61-f339-476c-8a2e-a303c04e274f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Acquiring lock "cinder-quobyte-6bcdff61-f339-476c-8a2e-a303c04e274f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Lock "cinder-quobyte-6bcdff61-f339-476c-8a2e-a303c04e274f" acquired by "delete_volume" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c305d75-ecd3-49a9-9320-d7a49f768d99]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:48 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f Nov 05 22:28:48 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:48 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f" returned: 0 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:48 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f Nov 05 22:28:48 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:48 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6bcdff61-f339-476c-8a2e-a303c04e274f" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Lock "cinder-quobyte-6bcdff61-f339-476c-8a2e-a303c04e274f" released by "delete_volume" :: held 0.653s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Created reservations ['e50049a7-d3d0-4214-8807-cb80d829cece', '0650e4f6-cc52-47ec-8cc0-ff5909cc88ce', '8414807d-b98b-4334-87fb-a9ee1d654607', 'b8d69dfb-0f76-439c-8f46-8a4e0fe3e7f7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:48 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:48 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:49 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.259s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Deleted volume successfully. Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4e96acc2-d2e8-4a1d-8787-20f627278ee7 tempest-ProjectReaderTests-471772236 None] Lock "cinder-6bcdff61-f339-476c-8a2e-a303c04e274f-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (bc6cd374-85a0-4790-a7b7-93403c846a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f680122-528f-4b9c-85dc-bb9577ef1612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f680122-528f-4b9c-85dc-bb9577ef1612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-988593364',display_name='tempest-VolumesGetTest-Volume-1325126449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa57f1e-a87f-4b74-8608-2bb7a6b500b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:49Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e5d1f6-2277-42b9-98ae-563c2a428c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e5d1f6-2277-42b9-98ae-563c2a428c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a185e48-ee39-43c2-8bc3-acf5e2e49424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a185e48-ee39-43c2-8bc3-acf5e2e49424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa57f1e-a87f-4b74-8608-2bb7a6b500b6', 'volume_name': 'volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d1f1f7-7106-4939-aa5f-07ae7f07f24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d1f1f7-7106-4939-aa5f-07ae7f07f24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6b528b-a903-4c49-8609-e9c6491c3224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:49 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Volume 0aa57f1e-a87f-4b74-8608-2bb7a6b500b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6', 'volume_size': 1} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-988593364',display_name='tempest-VolumesGetTest-Volume-1325126449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa57f1e-a87f-4b74-8608-2bb7a6b500b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:49Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Creating volume 0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:49 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:49 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 1073741824 Nov 05 22:28:49 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Flow 'volume_create_manager' (64660680-7f5a-4ff0-b6b2-ddafbbf6c7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9636962c-afb9-454e-a3ee-d2dc4e796456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9636962c-afb9-454e-a3ee-d2dc4e796456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-949940131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc123618-9db1-4c78-bcef-fafcf95e47cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d342e859b55e496fbd3554eab72d1baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:50Z,use_quota=True,user_id='3c6f9f7804924c0d95ed674c40611427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdc4a47-dde9-451e-a2ef-bf4f574d7328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bdc4a47-dde9-451e-a2ef-bf4f574d7328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6a2f11-418d-4972-9e3d-5f72744e60e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6a2f11-418d-4972-9e3d-5f72744e60e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc123618-9db1-4c78-bcef-fafcf95e47cc', 'volume_name': 'volume-fc123618-9db1-4c78-bcef-fafcf95e47cc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6033990-e6de-4786-9590-cec3412dfe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6033990-e6de-4786-9590-cec3412dfe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075ae995-078b-48f2-8e24-f89a09897863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:49 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Volume fc123618-9db1-4c78-bcef-fafcf95e47cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc123618-9db1-4c78-bcef-fafcf95e47cc', 'volume_size': 1} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:49 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 1073741824" returned: 0 in 0.453s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:49 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 Nov 05 22:28:49 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:50 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6" returned: 0 in 0.236s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.348s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-949940131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc123618-9db1-4c78-bcef-fafcf95e47cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d342e859b55e496fbd3554eab72d1baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:50Z,use_quota=True,user_id='3c6f9f7804924c0d95ed674c40611427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Creating volume fc123618-9db1-4c78-bcef-fafcf95e47cc {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:50 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6b528b-a903-4c49-8609-e9c6491c3224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c878b272-9d99-46ed-859f-2be88494586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:50 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc 1073741824 Nov 05 22:28:50 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Volume volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 (0aa57f1e-a87f-4b74-8608-2bb7a6b500b6): created successfully Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c878b272-9d99-46ed-859f-2be88494586e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (bc6cd374-85a0-4790-a7b7-93403c846a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e400e083-abef-430c-bb2a-94d6708229b3 tempest-VolumesGetTest-1845019465 None] Created volume successfully. Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Lock "cinder-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-quobyte-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6" acquired by "delete_volume" :: waited 0.012s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4018297-d2bd-4584-a109-85a3b2056b47]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:50 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc 1073741824" returned: 0 in 0.478s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:50 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc Nov 05 22:28:50 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:50 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 Nov 05 22:28:50 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:50 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075ae995-078b-48f2-8e24-f89a09897863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc123618-9db1-4c78-bcef-fafcf95e47cc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fc5032-2284-4399-b14f-fff9d416c2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:50 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Volume volume-fc123618-9db1-4c78-bcef-fafcf95e47cc (fc123618-9db1-4c78-bcef-fafcf95e47cc): created successfully Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fc5032-2284-4399-b14f-fff9d416c2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Flow 'volume_create_manager' (64660680-7f5a-4ff0-b6b2-ddafbbf6c7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0b9b617a-ec58-4c2c-904c-caf271babb94 tempest-ProjectReaderTests-471772236 None] Created volume successfully. Nov 05 22:28:51 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6 Nov 05 22:28:51 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:51 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6" returned: 0 in 0.239s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6" released by "delete_volume" :: held 0.671s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Created reservations ['0c1fe24c-d51b-4a56-ac22-c47665e399f2', '864f9114-c86a-434d-8979-bfc687e37afa', '996b597b-a131-4f4d-9b0a-da0c3dfbcc82', '8373160a-6507-4d28-a73a-f8b42db025b0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:51 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:51 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:51 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.255s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Deleted volume successfully. Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ca46c77-91e1-4a7e-acef-64ff21a7ad8b tempest-VolumesGetTest-1845019465 None] Lock "cinder-0aa57f1e-a87f-4b74-8608-2bb7a6b500b6-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-8bb725c8-f907-424d-bb73-68967fd331f4-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Lock "cinder-8bb725c8-f907-424d-bb73-68967fd331f4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-quobyte-8bb725c8-f907-424d-bb73-68967fd331f4" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-8bb725c8-f907-424d-bb73-68967fd331f4" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8fcb3-df18-456b-9906-ea315da22a07]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Acquiring lock "cinder-fc123618-9db1-4c78-bcef-fafcf95e47cc-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Lock "cinder-fc123618-9db1-4c78-bcef-fafcf95e47cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Acquiring lock "cinder-quobyte-fc123618-9db1-4c78-bcef-fafcf95e47cc" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Lock "cinder-quobyte-fc123618-9db1-4c78-bcef-fafcf95e47cc" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:51 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4 Nov 05 22:28:51 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1193cea3-157f-46d6-a68a-1254032ad676]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:52 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc Nov 05 22:28:52 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:52 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:52 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4 Nov 05 22:28:52 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:52 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc" returned: 0 in 0.366s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:52 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc Nov 05 22:28:52 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:52 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bb725c8-f907-424d-bb73-68967fd331f4" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-8bb725c8-f907-424d-bb73-68967fd331f4" released by "delete_volume" :: held 0.705s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:52 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-fc123618-9db1-4c78-bcef-fafcf95e47cc" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Lock "cinder-quobyte-fc123618-9db1-4c78-bcef-fafcf95e47cc" released by "delete_volume" :: held 0.675s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Created reservations ['d5a4dc51-28ba-4337-979c-84486e650e37', '6c482c2b-fb00-463d-a85c-d9070fd7a1dd', '20441e03-d6e6-41fa-8881-ae8c51642c2b', 'ec321c06-ee8d-4ca9-8bdd-1b6dc2786b44'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Created reservations ['ebba3cc8-9860-4d0b-894c-d4809f253f7b', '4d361cb6-6eb0-4dd7-affe-395811262a94', '6e6bee8c-cd0d-4f99-bac4-43ffd7165429', 'bc1d1a21-18cd-4f20-882e-dfa6294db508'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:53 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:53 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:53 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:28:53 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:53 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.259s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Deleted volume successfully. Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0b43d094-2bb7-4d3c-bacd-6360deb03fc0 tempest-VolumesGetTest-1845019465 None] Lock "cinder-8bb725c8-f907-424d-bb73-68967fd331f4-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:53 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Deleted volume successfully. Nov 05 22:28:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ce0f4710-74c1-489d-a949-0f1bf2671d65 tempest-ProjectReaderTests-471772236 None] Lock "cinder-fc123618-9db1-4c78-bcef-fafcf95e47cc-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (c1c68226-5520-42fb-874d-3af379d48f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c8514b-8032-423d-8bd2-114332cf2a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c8514b-8032-423d-8bd2-114332cf2a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-293786201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:54Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c115ef0-e774-487c-84c1-e9966ea9b57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c115ef0-e774-487c-84c1-e9966ea9b57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d98ee2-6f76-487d-97e2-47301790fe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d98ee2-6f76-487d-97e2-47301790fe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e', 'volume_name': 'volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311ee4ab-c70d-4cdc-b580-30cd93cc0e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311ee4ab-c70d-4cdc-b580-30cd93cc0e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2df37fb-1618-453d-8ea5-04d916912a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Volume 4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e', 'volume_size': 1} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-293786201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:54Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Creating volume 4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:28:54 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:54 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e 1073741824 Nov 05 22:28:54 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:54 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e 1073741824" returned: 0 in 0.475s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:55 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e Nov 05 22:28:55 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:55 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e" returned: 0 in 0.281s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:28:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2df37fb-1618-453d-8ea5-04d916912a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b203279-5b52-488b-8b5c-b8ced71d868a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Volume volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e (4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e): created successfully Nov 05 22:28:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b203279-5b52-488b-8b5c-b8ced71d868a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (c1c68226-5520-42fb-874d-3af379d48f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-af88f067-0ee3-4e72-a7e7-dd734374e80c tempest-VolumesGetTest-1845019465 None] Created volume successfully. Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (62994f16-5e8d-4656-bcef-40be921b9f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9307cf-419d-4b2a-8c8b-5b0d7a15bcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9307cf-419d-4b2a-8c8b-5b0d7a15bcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-921365171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7579032-32d6-4c74-8a86-218101b3d7e3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:57Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bede05b-460a-4993-bee7-1ebbf5c22af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bede05b-460a-4993-bee7-1ebbf5c22af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58ef034-1a36-461d-8d10-e92adc97beee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58ef034-1a36-461d-8d10-e92adc97beee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a7579032-32d6-4c74-8a86-218101b3d7e3', 'volume_name': 'volume-a7579032-32d6-4c74-8a86-218101b3d7e3', 'volume_size': 1, 'source_volid': '4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e', 'source_volstatus': 'available'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c3c6d4-b753-4e0c-b7b1-3dcd5f6ff319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c3c6d4-b753-4e0c-b7b1-3dcd5f6ff319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d7f6cf-69dc-4735-94f9-693bef788c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Volume a7579032-32d6-4c74-8a86-218101b3d7e3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a7579032-32d6-4c74-8a86-218101b3d7e3', 'volume_size': 1, 'source_volid': '4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e', 'source_volstatus': 'available'} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:56 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Cloning volume 4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e to volume a7579032-32d6-4c74-8a86-218101b3d7e3 Nov 05 22:28:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Creating offline snapshot 3b38d15c-b332-4679-a7b0-536dfd5ba69d of volume 4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:28:57 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5147945a-378b-45ea-827e-feddf04240df]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:57 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e Nov 05 22:28:57 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:57 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:57 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d 1G Nov 05 22:28:57 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:28:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:28:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:28:57 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d 1G" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:57 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d Nov 05 22:28:57 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:58 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:58 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d is being set with open permissions: ugo+rw Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:58 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d Nov 05 22:28:58 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:58 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d" returned: 0 in 0.233s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:58 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.info Nov 05 22:28:58 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:58 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.info" returned: 0 in 0.245s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:58 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.info is being set with open permissions: ugo+rw Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:58 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.info Nov 05 22:28:58 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:58 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.info" returned: 0 in 0.256s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-quobyte-a7579032-32d6-4c74-8a86-218101b3d7e3" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-a7579032-32d6-4c74-8a86-218101b3d7e3" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] snapshot: 3b38d15c-b332-4679-a7b0-536dfd5ba69d, volume: a7579032-32d6-4c74-8a86-218101b3d7e3, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b379fdf-a7b2-484f-a666-c8f4c0ff5f65]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:59 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d Nov 05 22:28:59 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:59 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d" returned: 0 in 0.350s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:28:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4af3a6-1717-4780-a21c-42d816525273]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:59 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e Nov 05 22:28:59 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:59 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:28:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:28:59 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:28:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:59 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 Nov 05 22:28:59 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:05 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3" returned: 0 in 5.602s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:29:05 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Converted 1024.00 MB image at 182.76 MB/s Nov 05 22:29:05 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 is being set with open permissions: ugo+rw Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:05 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 Nov 05 22:29:05 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:05 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3" returned: 0 in 0.228s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-a7579032-32d6-4c74-8a86-218101b3d7e3" released by "_copy_volume_from_snapshot" :: held 6.604s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-quobyte-3b38d15c-b332-4679-a7b0-536dfd5ba69d" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-3b38d15c-b332-4679-a7b0-536dfd5ba69d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Deleting offline snapshot 3b38d15c-b332-4679-a7b0-536dfd5ba69d of volume 4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] snapshot_file for this snap is: volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6508e6a-b3c4-4942-9084-62d296d9f95a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:05 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d Nov 05 22:29:05 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:05 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e236a42-679f-4b03-a33c-31f854a21c3a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:06 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e Nov 05 22:29:06 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:06 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e" returned: 0 in 0.506s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:06 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d Nov 05 22:29:06 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:06 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:06 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d Nov 05 22:29:06 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:06 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e.3b38d15c-b332-4679-a7b0-536dfd5ba69d" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-3b38d15c-b332-4679-a7b0-536dfd5ba69d" released by "_delete_snapshot" :: held 1.502s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.043s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d7f6cf-69dc-4735-94f9-693bef788c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7579032-32d6-4c74-8a86-218101b3d7e3', 'volume_size': 1, 'source_volid': '4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e', 'source_volstatus': 'available'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb6cc51-75ec-49dd-9d40-bd4297af2243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Volume volume-a7579032-32d6-4c74-8a86-218101b3d7e3 (a7579032-32d6-4c74-8a86-218101b3d7e3): created successfully Nov 05 22:29:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb6cc51-75ec-49dd-9d40-bd4297af2243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (62994f16-5e8d-4656-bcef-40be921b9f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e7c3887d-c7fc-4770-81b7-eaa54c1699d6 tempest-VolumesGetTest-1845019465 None] Created volume successfully. Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (f205c246-d4d4-414f-b94a-de478446349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b60f685-77cb-4d52-9542-9d7805cde7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b60f685-77cb-4d52-9542-9d7805cde7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1907540069',display_name='tempest-VolumesGetTest-Volume-1499365517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed6fa15-a699-4083-904e-9b452f827e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:08Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f003883e-e7a8-4be4-bd63-23bbd7c80207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f003883e-e7a8-4be4-bd63-23bbd7c80207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843cbd5c-23ca-4d79-b473-8bc9b830dd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843cbd5c-23ca-4d79-b473-8bc9b830dd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed6fa15-a699-4083-904e-9b452f827e5e', 'volume_name': 'volume-bed6fa15-a699-4083-904e-9b452f827e5e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387d06b2-707a-4983-b8ee-eda490cdc29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387d06b2-707a-4983-b8ee-eda490cdc29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d985edc7-33ee-4858-ba8c-44f0eacfcb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Volume bed6fa15-a699-4083-904e-9b452f827e5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed6fa15-a699-4083-904e-9b452f827e5e', 'volume_size': 1} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1907540069',display_name='tempest-VolumesGetTest-Volume-1499365517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed6fa15-a699-4083-904e-9b452f827e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:08Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Creating volume bed6fa15-a699-4083-904e-9b452f827e5e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:08 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:08 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e 1073741824 Nov 05 22:29:08 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:08 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e 1073741824" returned: 0 in 0.415s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=110,cinder:UPDATE=162,cinder:INSERT=43,cinder:DELETE=16 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:29:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:08 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e Nov 05 22:29:08 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:09 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d985edc7-33ee-4858-ba8c-44f0eacfcb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed6fa15-a699-4083-904e-9b452f827e5e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79ca3ee-bde8-43a1-9143-0327c5ee9d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:09 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Volume volume-bed6fa15-a699-4083-904e-9b452f827e5e (bed6fa15-a699-4083-904e-9b452f827e5e): created successfully Nov 05 22:29:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79ca3ee-bde8-43a1-9143-0327c5ee9d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:09 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (f205c246-d4d4-414f-b94a-de478446349a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:09 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=119,cinder:UPDATE=170,cinder:INSERT=42,cinder:DELETE=14 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:29:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-537f6953-3f1b-4363-91bf-12795c38e0e9 tempest-VolumesGetTest-1845019465 None] Created volume successfully. Nov 05 22:29:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-bed6fa15-a699-4083-904e-9b452f827e5e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Lock "cinder-bed6fa15-a699-4083-904e-9b452f827e5e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-quobyte-bed6fa15-a699-4083-904e-9b452f827e5e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-bed6fa15-a699-4083-904e-9b452f827e5e" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:10 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e74cc35-fd0b-4f21-8feb-76c1567bd816]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:10 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e Nov 05 22:29:10 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:10 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e" returned: 0 in 0.354s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:10 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e Nov 05 22:29:10 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:11 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-bed6fa15-a699-4083-904e-9b452f827e5e" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-bed6fa15-a699-4083-904e-9b452f827e5e" released by "delete_volume" :: held 0.634s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Created reservations ['af20a452-8043-4a96-afd4-2c39c2d00f28', '12adace9-4685-49af-82e3-1ec2bdb20af5', 'a68904e6-38d1-4459-bc42-02d85d2816d2', '9fae89ff-5aef-42b1-a2a1-299ac39135b7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:11 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:29:11 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:11 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.238s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Deleted volume successfully. Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-825f8759-828e-40eb-ab7f-a929fc32c4c9 tempest-VolumesGetTest-1845019465 None] Lock "cinder-bed6fa15-a699-4083-904e-9b452f827e5e-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-a7579032-32d6-4c74-8a86-218101b3d7e3-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Lock "cinder-a7579032-32d6-4c74-8a86-218101b3d7e3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-quobyte-a7579032-32d6-4c74-8a86-218101b3d7e3" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-a7579032-32d6-4c74-8a86-218101b3d7e3" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a6bd19-cbc8-414d-9120-58557a195d00]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:11 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 Nov 05 22:29:11 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:12 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3" returned: 0 in 0.344s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:12 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3 Nov 05 22:29:12 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:12 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7579032-32d6-4c74-8a86-218101b3d7e3" returned: 0 in 0.233s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-a7579032-32d6-4c74-8a86-218101b3d7e3" released by "delete_volume" :: held 0.618s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Created reservations ['97de47ec-25c9-4588-810c-801124bce621', 'f7993992-df8a-41df-941c-7db9a255a677', '881f1378-0579-46bb-8845-3238e27ab768', '2e4a5e66-5fb6-4613-9e4e-5f2165ec5a25'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:12 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:29:12 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:12 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.241s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:12 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Deleted volume successfully. Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-43181973-9163-4955-a2c1-18828f6cf839 tempest-VolumesGetTest-1845019465 None] Lock "cinder-a7579032-32d6-4c74-8a86-218101b3d7e3-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Lock "cinder-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-quobyte-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e" acquired by "delete_volume" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b2ac0e-54b1-4728-bfd6-f5a1b3e51520]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:13 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e Nov 05 22:29:13 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:13 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e" returned: 0 in 0.355s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:13 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e Nov 05 22:29:13 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:13 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e" returned: 0 in 0.245s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e" released by "delete_volume" :: held 0.657s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Created reservations ['f7c1f5bb-4992-4e9f-8431-fda4de48f18d', 'a5365908-7ccd-44fd-88a7-f8dda2228801', 'abec8fc7-c0b8-49a2-be78-4d2563290cdc', '6705fe37-49d6-40cf-a016-e87ed25cc33a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:13 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:29:13 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:13 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.239s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:13 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Deleted volume successfully. Nov 05 22:29:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-894190cd-fef1-4492-8649-fad6eba5f2f2 tempest-VolumesGetTest-1845019465 None] Lock "cinder-4d38a0b8-3ce6-44d3-ac3b-62ecf288a16e-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:14 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (fee6bbc7-63de-49ce-8e2f-77e5d8a475d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e88373-4c71-457c-afc1-bd8777fb8b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e88373-4c71-457c-afc1-bd8777fb8b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-504056455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:15Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9c8280-c88a-4cb0-99ef-eb8f9641f17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9c8280-c88a-4cb0-99ef-eb8f9641f17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c883269-414d-40b5-9d5b-73e82f52e665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:14 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c883269-414d-40b5-9d5b-73e82f52e665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be', 'volume_name': 'volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ed717c-090a-45f3-ad66-10091bf9b722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ed717c-090a-45f3-ad66-10091bf9b722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa083b1-83f9-4942-b1e6-6d1ec649898f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Volume 21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Trying to clone 21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be from image a030b230-32ee-42bd-ba4c-7115346087a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:29:15 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Image download 20.69 MB at 20.69 MB/s Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a0eec6-fbee-4d02-a47a-7f50f7c4ea8b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:15 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD Nov 05 22:29:15 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:15 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Temporary image a030b230-32ee-42bd-ba4c-7115346087a9 is fetched for user 8296b5ee1b3141198657accbc66c7e80. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3667ad49-d74f-4321-8ff4-faf9f64aab07]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:15 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD Nov 05 22:29:15 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:16 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-504056455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:15Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Creating volume 21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:16 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:16 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be 1073741824 Nov 05 22:29:16 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:16 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be 1073741824" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:16 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be Nov 05 22:29:16 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:16 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Attempting download of a030b230-32ee-42bd-ba4c-7115346087a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}])) to volume 21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6576700f-b211-41a9-8037-790fb25b0494]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_gcyhrupd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:16 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_gcyhrupd Nov 05 22:29:16 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:17 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_gcyhrupd" returned: 0 in 0.310s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_gcyhrupd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:17 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_gcyhrupd Nov 05 22:29:17 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:17 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_gcyhrupd" returned: 1 in 0.301s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a030b230-32ee-42bd-ba4c-7115346087a9_gcyhrupd' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:29:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3725a3e9-8bf4-4da8-8b20-69c07ffd5ac3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:17 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD Nov 05 22:29:17 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:17 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:17 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] a030b230-32ee-42bd-ba4c-7115346087a9 was qcow2, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:29:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:17 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be Nov 05 22:29:17 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:19 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be" returned: 0 in 1.616s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a030b230-32ee-42bd-ba4c-7115346087a9_u5eqcl9pdevstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:29:19 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Converted 112.00 MB image at 69.24 MB/s Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:19 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be 1G Nov 05 22:29:19 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:19 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be 1G" returned: 0 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Downloaded image a030b230-32ee-42bd-ba4c-7115346087a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}])) to volume 21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Temporary image a030b230-32ee-42bd-ba4c-7115346087a9 for user 8296b5ee1b3141198657accbc66c7e80 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Marking volume 21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Copying metadata from image a030b230-32ee-42bd-ba4c-7115346087a9 to 21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Creating volume glance metadata for volume 21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be backed by image a030b230-32ee-42bd-ba4c-7115346087a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa083b1-83f9-4942-b1e6-6d1ec649898f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be', 'volume_size': 1, 'image_id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a030b230-32ee-42bd-ba4c-7115346087a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '508033ad27be4e7596d01ddc759ec115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a030b230-32ee-42bd-ba4c-7115346087a9', 'created_at': datetime.datetime(2026, 11, 5, 21, 8, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a030b230-32ee-42bd-ba4c-7115346087a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7549e252-9321-4c32-ab79-1db1f11a60ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Volume volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be (21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be): created successfully Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7549e252-9321-4c32-ab79-1db1f11a60ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (fee6bbc7-63de-49ce-8e2f-77e5d8a475d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-94e232d6-1861-41eb-ab6f-c9ba46469398 tempest-VolumesGetTest-1845019465 None] Created volume successfully. Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (d445af9c-665f-4fc8-a115-c0d19e89f6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d78fc8-3cd1-4cd8-8ca2-fcd2ea10242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d78fc8-3cd1-4cd8-8ca2-fcd2ea10242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1319426656',display_name='tempest-VolumesGetTest-Volume-1865189870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576ed313-fdea-430f-a61b-4ec7d38fd5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:21Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41345fb6-c341-4908-962a-3b4190c43374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41345fb6-c341-4908-962a-3b4190c43374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4ac31e-84c1-4367-998b-585395380ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4ac31e-84c1-4367-998b-585395380ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576ed313-fdea-430f-a61b-4ec7d38fd5dd', 'volume_name': 'volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b713df62-41c8-4348-b8c5-ac1c6f724cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b713df62-41c8-4348-b8c5-ac1c6f724cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fb8ace-9d15-4051-b120-45c21835ae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Volume 576ed313-fdea-430f-a61b-4ec7d38fd5dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd', 'volume_size': 1} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1319426656',display_name='tempest-VolumesGetTest-Volume-1865189870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576ed313-fdea-430f-a61b-4ec7d38fd5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86f09c2893542ee89b0a914e4bf3e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:21Z,use_quota=True,user_id='8296b5ee1b3141198657accbc66c7e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Creating volume 576ed313-fdea-430f-a61b-4ec7d38fd5dd {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:20 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:29:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:20 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd 1073741824 Nov 05 22:29:20 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:21 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd 1073741824" returned: 0 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:21 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd Nov 05 22:29:21 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:21 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd" returned: 0 in 0.233s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fb8ace-9d15-4051-b120-45c21835ae6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2bc7da-a6b4-4e28-b3fa-22d4310f07fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Volume volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd (576ed313-fdea-430f-a61b-4ec7d38fd5dd): created successfully Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2bc7da-a6b4-4e28-b3fa-22d4310f07fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Flow 'volume_create_manager' (d445af9c-665f-4fc8-a115-c0d19e89f6b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5725db38-4233-4a2c-9c6e-88130c396e05 tempest-VolumesGetTest-1845019465 None] Created volume successfully. Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-576ed313-fdea-430f-a61b-4ec7d38fd5dd-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Lock "cinder-576ed313-fdea-430f-a61b-4ec7d38fd5dd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-quobyte-576ed313-fdea-430f-a61b-4ec7d38fd5dd" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-576ed313-fdea-430f-a61b-4ec7d38fd5dd" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7e8a6e-971d-400a-8893-43c6f01748c5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:21 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd Nov 05 22:29:21 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:22 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd" returned: 0 in 0.347s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:22 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd Nov 05 22:29:22 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:22 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-576ed313-fdea-430f-a61b-4ec7d38fd5dd" returned: 0 in 0.239s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-576ed313-fdea-430f-a61b-4ec7d38fd5dd" released by "delete_volume" :: held 0.628s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Created reservations ['f0615a61-d9a2-4222-9454-dbe69db49515', 'd380c377-057c-433e-bec7-1c23471ba25f', '3bd44263-8707-4f4c-a601-0440614e01b3', '6d6de82a-d6b3-4517-8c3b-d4fb2b25ad1f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:22 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:29:22 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:22 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Deleted volume successfully. Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10d8c254-421c-4b0e-8ade-15dcf602d22a tempest-VolumesGetTest-1845019465 None] Lock "cinder-576ed313-fdea-430f-a61b-4ec7d38fd5dd-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Lock "cinder-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Acquiring lock "cinder-quobyte-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be" acquired by "delete_volume" :: waited 0.011s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4ce8d6-bf4d-4069-ada2-1e911a7e4f53]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:23 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be Nov 05 22:29:23 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:23 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be" returned: 0 in 0.344s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:23 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be Nov 05 22:29:23 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:23 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be" returned: 0 in 0.239s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Lock "cinder-quobyte-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be" released by "delete_volume" :: held 0.618s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Created reservations ['c02ffbff-2f27-40b8-b925-5bda636b8d69', 'cad2eefe-8840-4825-95ac-10f3c96c4831', 'e441270d-9bd3-463d-837a-1cf5aa074b5b', '8f308f6f-606b-4553-b63f-a61e13c3d9e4'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:23 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:29:23 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:24 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.241s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:24 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Deleted volume successfully. Nov 05 22:29:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d65f491c-0824-4954-b1e4-3c5f9a1dec4d tempest-VolumesGetTest-1845019465 None] Lock "cinder-21a834a8-1f3e-4271-8b3e-bf6cb1c3e4be-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Flow 'volume_create_manager' (4cd194c8-5289-4565-b7e0-0bf239db258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6712ec8-44b7-44a5-8a5d-ebd28326e452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6712ec8-44b7-44a5-8a5d-ebd28326e452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2080683035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97685865-4719-481c-a513-df5f00df70bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa23ea56f75419d95fabaa938d92a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:27Z,use_quota=True,user_id='f267af91e82f4ac992873660c663e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c734f436-1dc1-472b-8936-21363b249ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c734f436-1dc1-472b-8936-21363b249ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6ddcd7-df1e-4c6e-b924-08e00707ce67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6ddcd7-df1e-4c6e-b924-08e00707ce67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97685865-4719-481c-a513-df5f00df70bd', 'volume_name': 'volume-97685865-4719-481c-a513-df5f00df70bd', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1701759-a2ea-4a53-8a2e-a9e33d7f09a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1701759-a2ea-4a53-8a2e-a9e33d7f09a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8427be4b-730f-4d7a-88b5-e981301ae356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:27 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Volume 97685865-4719-481c-a513-df5f00df70bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97685865-4719-481c-a513-df5f00df70bd', 'volume_size': 1} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2080683035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97685865-4719-481c-a513-df5f00df70bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa23ea56f75419d95fabaa938d92a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:27Z,use_quota=True,user_id='f267af91e82f4ac992873660c663e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Creating volume 97685865-4719-481c-a513-df5f00df70bd {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:27 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:29:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:27 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd 1073741824 Nov 05 22:29:27 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:28 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd 1073741824" returned: 0 in 0.401s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:28 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd Nov 05 22:29:28 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:28 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd" returned: 0 in 0.236s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8427be4b-730f-4d7a-88b5-e981301ae356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97685865-4719-481c-a513-df5f00df70bd', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42efb988-ecda-4ffe-9128-ef513eac6865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Volume volume-97685865-4719-481c-a513-df5f00df70bd (97685865-4719-481c-a513-df5f00df70bd): created successfully Nov 05 22:29:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42efb988-ecda-4ffe-9128-ef513eac6865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Flow 'volume_create_manager' (4cd194c8-5289-4565-b7e0-0bf239db258c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4f32fc55-48f3-44a8-bcec-9e04e5aa7b36 tempest-VolumesListTestJSON-111312293 None] Created volume successfully. Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Flow 'volume_create_manager' (4a494010-fded-4043-8979-31d80c2be186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48331d45-dac0-41aa-8ec6-c659f84b035f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48331d45-dac0-41aa-8ec6-c659f84b035f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-281949756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3715a4a2-1b2f-43e4-9c6f-40da23a59497,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa23ea56f75419d95fabaa938d92a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:29Z,use_quota=True,user_id='f267af91e82f4ac992873660c663e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba19be2a-7fef-4169-8c5f-f3d65367c99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba19be2a-7fef-4169-8c5f-f3d65367c99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a420a3-e1b4-4df3-b2da-9e0b20378538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a420a3-e1b4-4df3-b2da-9e0b20378538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3715a4a2-1b2f-43e4-9c6f-40da23a59497', 'volume_name': 'volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c324ffd-d040-4fab-a5d6-f9a8f18af6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c324ffd-d040-4fab-a5d6-f9a8f18af6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6f63db-0f6b-4f0e-9634-924aa388eb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:29 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Volume 3715a4a2-1b2f-43e4-9c6f-40da23a59497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497', 'volume_size': 1} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-281949756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3715a4a2-1b2f-43e4-9c6f-40da23a59497,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa23ea56f75419d95fabaa938d92a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:29Z,use_quota=True,user_id='f267af91e82f4ac992873660c663e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Creating volume 3715a4a2-1b2f-43e4-9c6f-40da23a59497 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:29 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:29 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497 1073741824 Nov 05 22:29:29 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:29 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497 1073741824" returned: 0 in 0.410s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:29 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497 Nov 05 22:29:29 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:29 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497" returned: 0 in 0.262s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6f63db-0f6b-4f0e-9634-924aa388eb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2348f80d-5c2c-4fba-a26f-3366a5d138e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:29 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Volume volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497 (3715a4a2-1b2f-43e4-9c6f-40da23a59497): created successfully Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2348f80d-5c2c-4fba-a26f-3366a5d138e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Flow 'volume_create_manager' (4a494010-fded-4043-8979-31d80c2be186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-cec67bd6-96a1-44cb-ad35-bbfb5817b471 tempest-VolumesListTestJSON-111312293 None] Created volume successfully. Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Flow 'volume_create_manager' (cf36ded3-ed98-4f20-95d4-5ac9952a8121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0438dbb-1cfe-46fb-8a57-d0e867ea0b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0438dbb-1cfe-46fb-8a57-d0e867ea0b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1125417463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfa624b-326d-4773-82d9-a51a0bacf43b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa23ea56f75419d95fabaa938d92a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:30Z,use_quota=True,user_id='f267af91e82f4ac992873660c663e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3591d5dc-538d-433a-8a30-1e2b401fdde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3591d5dc-538d-433a-8a30-1e2b401fdde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63065757-4bac-417a-9a49-b0b0dc982180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63065757-4bac-417a-9a49-b0b0dc982180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bfa624b-326d-4773-82d9-a51a0bacf43b', 'volume_name': 'volume-8bfa624b-326d-4773-82d9-a51a0bacf43b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da389811-e670-4279-8284-84e5ee3e1756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da389811-e670-4279-8284-84e5ee3e1756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c63581-202e-4f82-ba3e-3eae498a40c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:30 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Volume 8bfa624b-326d-4773-82d9-a51a0bacf43b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bfa624b-326d-4773-82d9-a51a0bacf43b', 'volume_size': 1} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1125417463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfa624b-326d-4773-82d9-a51a0bacf43b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8aa23ea56f75419d95fabaa938d92a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:30Z,use_quota=True,user_id='f267af91e82f4ac992873660c663e07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Creating volume 8bfa624b-326d-4773-82d9-a51a0bacf43b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:30 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:30 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b 1073741824 Nov 05 22:29:30 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:30 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b 1073741824" returned: 0 in 0.386s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:31 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b Nov 05 22:29:31 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:31 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c63581-202e-4f82-ba3e-3eae498a40c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bfa624b-326d-4773-82d9-a51a0bacf43b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad530f1-b180-4d44-bb5f-1568f26f3077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:31 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Volume volume-8bfa624b-326d-4773-82d9-a51a0bacf43b (8bfa624b-326d-4773-82d9-a51a0bacf43b): created successfully Nov 05 22:29:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad530f1-b180-4d44-bb5f-1568f26f3077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:31 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Flow 'volume_create_manager' (cf36ded3-ed98-4f20-95d4-5ac9952a8121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bf0d1319-a640-4002-9a73-43d120f2917a tempest-VolumesListTestJSON-111312293 None] Created volume successfully. Nov 05 22:29:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Acquiring lock "cinder-8bfa624b-326d-4773-82d9-a51a0bacf43b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Lock "cinder-8bfa624b-326d-4773-82d9-a51a0bacf43b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Acquiring lock "cinder-quobyte-8bfa624b-326d-4773-82d9-a51a0bacf43b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Lock "cinder-quobyte-8bfa624b-326d-4773-82d9-a51a0bacf43b" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9b1351-4110-471d-bcff-68a0bd86f201]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:33 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b Nov 05 22:29:33 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:33 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:33 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b Nov 05 22:29:33 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:34 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8bfa624b-326d-4773-82d9-a51a0bacf43b" returned: 0 in 0.235s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Lock "cinder-quobyte-8bfa624b-326d-4773-82d9-a51a0bacf43b" released by "delete_volume" :: held 0.621s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Created reservations ['7a84f086-dab4-4b22-a5b2-1b8d8bbf56bf', 'e2752bb2-ec31-428a-ae87-e2ef04cb5139', '917668c3-47f3-4b5a-a7d4-05be7263cfa6', '6c56a8d0-8fd3-4615-91b1-6e75bc567e03'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:34 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:29:34 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:34 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.227s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Deleted volume successfully. Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65d1d4b4-32b4-44d9-a276-100be0fb178e tempest-VolumesListTestJSON-111312293 None] Lock "cinder-8bfa624b-326d-4773-82d9-a51a0bacf43b-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Acquiring lock "cinder-3715a4a2-1b2f-43e4-9c6f-40da23a59497-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Lock "cinder-3715a4a2-1b2f-43e4-9c6f-40da23a59497-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Acquiring lock "cinder-quobyte-3715a4a2-1b2f-43e4-9c6f-40da23a59497" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Lock "cinder-quobyte-3715a4a2-1b2f-43e4-9c6f-40da23a59497" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[956734c4-1d50-4489-98ba-df3b8ba4e1c8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:34 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497 Nov 05 22:29:34 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:35 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497" returned: 0 in 0.343s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:35 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497 Nov 05 22:29:35 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:35 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3715a4a2-1b2f-43e4-9c6f-40da23a59497" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Lock "cinder-quobyte-3715a4a2-1b2f-43e4-9c6f-40da23a59497" released by "delete_volume" :: held 0.617s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Created reservations ['24ee50df-32cc-40a2-91b6-b9cb419dfe2b', '18e9be87-4ab7-449a-8e4f-b53dde088ddd', '2776dfed-e282-44e8-880d-bfe0628bd8f0', 'c6579b84-6742-48d2-8c6a-ee91e30919c2'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:35 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:29:35 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:35 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.232s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Deleted volume successfully. Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1a309718-5154-470b-acbe-80d322ec981f tempest-VolumesListTestJSON-111312293 None] Lock "cinder-3715a4a2-1b2f-43e4-9c6f-40da23a59497-delete_volume" released by "delete_volume" :: held 1.021s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Acquiring lock "cinder-97685865-4719-481c-a513-df5f00df70bd-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Lock "cinder-97685865-4719-481c-a513-df5f00df70bd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Acquiring lock "cinder-quobyte-97685865-4719-481c-a513-df5f00df70bd" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Lock "cinder-quobyte-97685865-4719-481c-a513-df5f00df70bd" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f927dd3-d33b-415d-9e30-047bead77e97]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:35 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd Nov 05 22:29:35 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:36 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd" returned: 0 in 0.343s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:36 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd Nov 05 22:29:36 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:36 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-97685865-4719-481c-a513-df5f00df70bd" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Lock "cinder-quobyte-97685865-4719-481c-a513-df5f00df70bd" released by "delete_volume" :: held 0.619s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Created reservations ['0b839258-b06a-4f70-a837-dbf0a0f0e456', '51c14f77-6336-46bd-a8ea-2f72d76032dc', '5e899ebb-cfd3-42e9-882e-f080aef9ed49', '7dbd1877-cd7f-4a08-9faa-8be00faf0865'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:36 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:29:36 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:36 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.234s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Deleted volume successfully. Nov 05 22:29:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5cdbcf4-68bb-4946-905c-3adfb0d9f20a tempest-VolumesListTestJSON-111312293 None] Lock "cinder-97685865-4719-481c-a513-df5f00df70bd-delete_volume" released by "delete_volume" :: held 1.025s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Flow 'volume_create_manager' (17abf3b0-884e-4d8b-8293-f9993511da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3657d6f-22c3-4d02-ac42-0c3d893b0fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3657d6f-22c3-4d02-ac42-0c3d893b0fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-582428687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7465a84-d62c-472b-aad6-47136130b0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7736805d7044319809ebb9452fe2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:40Z,use_quota=True,user_id='f56ea1067b1e4ce4a0d4586454135b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969bcd64-3dc7-4ee7-b83d-7dba635c5156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969bcd64-3dc7-4ee7-b83d-7dba635c5156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d1beb5-d693-471b-8b34-5454f5178c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d1beb5-d693-471b-8b34-5454f5178c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7465a84-d62c-472b-aad6-47136130b0b5', 'volume_name': 'volume-a7465a84-d62c-472b-aad6-47136130b0b5', 'volume_size': 2}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed50129-05d9-4949-8b4f-06ef80183c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed50129-05d9-4949-8b4f-06ef80183c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (818ef774-c2c2-4b9f-966a-6dfa401c5b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Volume a7465a84-d62c-472b-aad6-47136130b0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7465a84-d62c-472b-aad6-47136130b0b5', 'volume_size': 2} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-582428687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7465a84-d62c-472b-aad6-47136130b0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c7736805d7044319809ebb9452fe2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:40Z,use_quota=True,user_id='f56ea1067b1e4ce4a0d4586454135b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Creating volume a7465a84-d62c-472b-aad6-47136130b0b5 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:40 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 2147483648 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:40 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 2147483648 Nov 05 22:29:40 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:40 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 2147483648" returned: 0 in 0.442s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:40 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 Nov 05 22:29:40 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:41 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5" returned: 0 in 0.243s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (818ef774-c2c2-4b9f-966a-6dfa401c5b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7465a84-d62c-472b-aad6-47136130b0b5', 'volume_size': 2}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2987aa-2760-4edb-93aa-fa4d4abbf12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Volume volume-a7465a84-d62c-472b-aad6-47136130b0b5 (a7465a84-d62c-472b-aad6-47136130b0b5): created successfully Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2987aa-2760-4edb-93aa-fa4d4abbf12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Flow 'volume_create_manager' (17abf3b0-884e-4d8b-8293-f9993511da50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-81088a48-a443-4d8c-91f8-358bb987075a tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Created volume successfully. Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Creating offline snapshot 1986de0c-4c89-4808-a239-dd56f087581c of volume a7465a84-d62c-472b-aad6-47136130b0b5 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc744278-d9e3-41bd-88cd-5f41601efd1b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:41 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 Nov 05 22:29:41 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:41 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5" returned: 0 in 0.340s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c 2G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:41 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c 2G Nov 05 22:29:41 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:42 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c 2G" returned: 0 in 0.377s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7465a84-d62c-472b-aad6-47136130b0b5 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:42 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7465a84-d62c-472b-aad6-47136130b0b5 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c Nov 05 22:29:42 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:42 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7465a84-d62c-472b-aad6-47136130b0b5 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:42 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c is being set with open permissions: ugo+rw Nov 05 22:29:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:42 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c Nov 05 22:29:42 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:42 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c" returned: 0 in 0.231s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:42 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.info Nov 05 22:29:42 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:43 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.info" returned: 0 in 0.233s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:43 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.info is being set with open permissions: ugo+rw Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:43 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.info Nov 05 22:29:43 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:43 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.info" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.772s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1359a18d-f872-4de7-85a7-18602181f80f tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Create snapshot completed successfully Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Acquiring lock "cinder-1986de0c-4c89-4808-a239-dd56f087581c-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "cinder-1986de0c-4c89-4808-a239-dd56f087581c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Acquiring lock "cinder-quobyte-a7465a84-d62c-472b-aad6-47136130b0b5" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "cinder-quobyte-a7465a84-d62c-472b-aad6-47136130b0b5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Acquiring lock "cinder-quobyte-1986de0c-4c89-4808-a239-dd56f087581c" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "cinder-quobyte-1986de0c-4c89-4808-a239-dd56f087581c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Deleting offline snapshot 1986de0c-4c89-4808-a239-dd56f087581c of volume a7465a84-d62c-472b-aad6-47136130b0b5 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] snapshot_file for this snap is: volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1ef106-a402-4862-aa71-08fc87313d72]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:43 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c Nov 05 22:29:43 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:44 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c" returned: 0 in 0.341s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7465a84-d62c-472b-aad6-47136130b0b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:29:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab9455f-065c-4fa6-964e-aa1761f4fb79]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:44 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 Nov 05 22:29:44 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:44 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5" returned: 0 in 0.343s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:44 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c Nov 05 22:29:44 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:44 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c" returned: 0 in 0.348s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:44 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c Nov 05 22:29:44 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:45 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5.1986de0c-4c89-4808-a239-dd56f087581c" returned: 0 in 0.233s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "cinder-quobyte-1986de0c-4c89-4808-a239-dd56f087581c" released by "_delete_snapshot" :: held 1.372s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "cinder-quobyte-a7465a84-d62c-472b-aad6-47136130b0b5" released by "delete_snapshot" :: held 1.397s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:45 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Created reservations ['2020f5e8-a9ca-42c2-8423-48ecc3f91b43', '2a747465-f0a6-497a-95b3-3cd14ea27c80', 'ad935f13-b2f3-4294-84be-43aab2e878a2', '1f41f69c-44e8-4bb9-a4f2-42d4bdc153f9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Delete snapshot completed successfully. Nov 05 22:29:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-cddb538d-8387-4df3-b8cb-da111b9493bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "cinder-1986de0c-4c89-4808-a239-dd56f087581c-delete_snapshot" released by "delete_snapshot" :: held 1.548s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Acquiring lock "cinder-a7465a84-d62c-472b-aad6-47136130b0b5-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "cinder-a7465a84-d62c-472b-aad6-47136130b0b5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Acquiring lock "cinder-quobyte-a7465a84-d62c-472b-aad6-47136130b0b5" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "cinder-quobyte-a7465a84-d62c-472b-aad6-47136130b0b5" acquired by "delete_volume" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea42591-4b22-4797-aab8-b2538fc51c5f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:46 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 Nov 05 22:29:46 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:46 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5" returned: 0 in 0.343s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:46 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5 Nov 05 22:29:46 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:46 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a7465a84-d62c-472b-aad6-47136130b0b5" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "cinder-quobyte-a7465a84-d62c-472b-aad6-47136130b0b5" released by "delete_volume" :: held 0.653s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Created reservations ['81fb0a8e-db1b-4cc2-99d1-c7991a3b9a0f', '6f8354f7-c0c3-4dc4-ab84-791a30dda9cc', 'e2234512-0982-4f17-a4ca-b7798623bf7e', '1c0a5be6-cf6c-4657-9401-489baea67c3f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:46 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:29:46 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:47 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:47 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Deleted volume successfully. Nov 05 22:29:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f0bc30d3-1428-4b94-83e8-8695236660bf tempest-VolumesSnapshotNegativeTestJSON-1431297278 None] Lock "cinder-a7465a84-d62c-472b-aad6-47136130b0b5-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:56 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=99,cinder:DELETE=6,cinder:SELECT=80,cinder:INSERT=32 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=67,cinder:INSERT=28,cinder:UPDATE=99,cinder:DELETE=11 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:57 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:29:57 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:57 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.304s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:29:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Flow 'volume_create_manager' (a963d605-5db4-4a84-bd57-23c8430b3518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb029718-70ee-44fb-a74d-219a7c7090ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb029718-70ee-44fb-a74d-219a7c7090ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-941290918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544b514b-311e-4c3d-8fd0-75b4847ca89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed86b8b2f8014837abb5a3ad78995f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:30:06Z,use_quota=True,user_id='496d1a23ffef4d65b2e72e65290cbf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfdb1f1-8e65-4d5d-b476-84c6dcaf1012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfdb1f1-8e65-4d5d-b476-84c6dcaf1012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f29c98-1711-4041-9e15-7ed02d4c10b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f29c98-1711-4041-9e15-7ed02d4c10b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544b514b-311e-4c3d-8fd0-75b4847ca89a', 'volume_name': 'volume-544b514b-311e-4c3d-8fd0-75b4847ca89a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7f8b95-edf4-44e0-8d59-dfb95cacc675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7f8b95-edf4-44e0-8d59-dfb95cacc675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016ed2c4-8403-45e7-bee2-2d24e2289bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Volume 544b514b-311e-4c3d-8fd0-75b4847ca89a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544b514b-311e-4c3d-8fd0-75b4847ca89a', 'volume_size': 1} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-941290918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544b514b-311e-4c3d-8fd0-75b4847ca89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed86b8b2f8014837abb5a3ad78995f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:30:06Z,use_quota=True,user_id='496d1a23ffef4d65b2e72e65290cbf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Creating volume 544b514b-311e-4c3d-8fd0-75b4847ca89a {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:30:06 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:06 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a 1073741824 Nov 05 22:30:06 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Flow 'volume_create_manager' (db21dc1d-2a1a-41d0-901f-379ede3e8357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e1fae6-7d9b-434c-baf3-550763652dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e1fae6-7d9b-434c-baf3-550763652dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-451427555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3550a58f-debb-4bb8-94a0-29a47ee3944e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed86b8b2f8014837abb5a3ad78995f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:30:07Z,use_quota=True,user_id='496d1a23ffef4d65b2e72e65290cbf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75662c24-f0f3-462d-a5d8-20081b2df6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75662c24-f0f3-462d-a5d8-20081b2df6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a151148-1f24-411d-86e5-71828e65d043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a151148-1f24-411d-86e5-71828e65d043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3550a58f-debb-4bb8-94a0-29a47ee3944e', 'volume_name': 'volume-3550a58f-debb-4bb8-94a0-29a47ee3944e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f9ed98-1e20-4452-bcfe-d19429c26b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f9ed98-1e20-4452-bcfe-d19429c26b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddb29f5-2469-4a37-be1b-455a7c2fbf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Volume 3550a58f-debb-4bb8-94a0-29a47ee3944e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3550a58f-debb-4bb8-94a0-29a47ee3944e', 'volume_size': 1} Nov 05 22:30:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:07 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a 1073741824" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:07 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a Nov 05 22:30:07 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:07 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-451427555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3550a58f-debb-4bb8-94a0-29a47ee3944e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed86b8b2f8014837abb5a3ad78995f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:30:07Z,use_quota=True,user_id='496d1a23ffef4d65b2e72e65290cbf35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Creating volume 3550a58f-debb-4bb8-94a0-29a47ee3944e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:30:07 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016ed2c4-8403-45e7-bee2-2d24e2289bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544b514b-311e-4c3d-8fd0-75b4847ca89a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31533ba-da4e-4259-b33b-f3b7902a26c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:07 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e 1073741824 Nov 05 22:30:07 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Volume volume-544b514b-311e-4c3d-8fd0-75b4847ca89a (544b514b-311e-4c3d-8fd0-75b4847ca89a): created successfully Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31533ba-da4e-4259-b33b-f3b7902a26c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Flow 'volume_create_manager' (a963d605-5db4-4a84-bd57-23c8430b3518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:30:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2d5c1614-59e0-4887-b67c-1422a25a73c9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Created volume successfully. Nov 05 22:30:07 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e 1073741824" returned: 0 in 0.435s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:07 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e Nov 05 22:30:07 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:08 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:30:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddb29f5-2469-4a37-be1b-455a7c2fbf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3550a58f-debb-4bb8-94a0-29a47ee3944e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a538d1d5-137c-4c81-8d31-6d9c98766a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Volume volume-3550a58f-debb-4bb8-94a0-29a47ee3944e (3550a58f-debb-4bb8-94a0-29a47ee3944e): created successfully Nov 05 22:30:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a538d1d5-137c-4c81-8d31-6d9c98766a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Flow 'volume_create_manager' (db21dc1d-2a1a-41d0-901f-379ede3e8357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:30:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a0d75e6e-605f-4ff8-b956-63646ac0fb5f tempest-TestServerVolumeAttachmentScenario-445206620 None] Created volume successfully. Nov 05 22:30:18 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:30:18 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:30:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a1cf3adb-8e8b-4120-9e67-322399ce8c8a req-2a857536-fe01-4a36-a4c2-690d74e5d133 tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a1cf3adb-8e8b-4120-9e67-322399ce8c8a req-2a857536-fe01-4a36-a4c2-690d74e5d133 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-a1cf3adb-8e8b-4120-9e67-322399ce8c8a req-2a857536-fe01-4a36-a4c2-690d74e5d133 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-a1cf3adb-8e8b-4120-9e67-322399ce8c8a req-2a857536-fe01-4a36-a4c2-690d74e5d133 tempest-TestServerVolumeAttachmentScenario-445206620 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-544b514b-311e-4c3d-8fd0-75b4847ca89a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0e9cc51-bafc-44cf-9ae7-a1e2fad7791c', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:30:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-a1cf3adb-8e8b-4120-9e67-322399ce8c8a req-2a857536-fe01-4a36-a4c2-690d74e5d133 tempest-TestServerVolumeAttachmentScenario-445206620 None] attachment_update completed successfully. Nov 05 22:30:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-ebf41291-4258-4e44-a920-8ee01957da97 req-c62c5cbe-344d-4af4-8881-08fc07246893 tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-ebf41291-4258-4e44-a920-8ee01957da97 req-c62c5cbe-344d-4af4-8881-08fc07246893 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-ebf41291-4258-4e44-a920-8ee01957da97 req-c62c5cbe-344d-4af4-8881-08fc07246893 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-ebf41291-4258-4e44-a920-8ee01957da97 req-c62c5cbe-344d-4af4-8881-08fc07246893 tempest-TestServerVolumeAttachmentScenario-445206620 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-3550a58f-debb-4bb8-94a0-29a47ee3944e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb978ed3-8fd0-4f91-9cd1-06122b9d2408', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:30:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-ebf41291-4258-4e44-a920-8ee01957da97 req-c62c5cbe-344d-4af4-8881-08fc07246893 tempest-TestServerVolumeAttachmentScenario-445206620 None] attachment_update completed successfully. Nov 05 22:30:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-3f30d8dd-488f-4c5c-805c-284e1f85de84 req-29595347-856b-4be3-ab49-033105f216c1 tempest-TestServerVolumeAttachmentScenario-445206620 None] Terminate volume connection completed successfully. Nov 05 22:30:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-3f30d8dd-488f-4c5c-805c-284e1f85de84 req-29595347-856b-4be3-ab49-033105f216c1 tempest-TestServerVolumeAttachmentScenario-445206620 None] Deleting attachment eb978ed3-8fd0-4f91-9cd1-06122b9d2408. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:30:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-167307fd-6df5-4052-a4d0-660e9e09cf13 req-c384c84f-e002-45bd-9f49-edb0842e78b9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Terminate volume connection completed successfully. Nov 05 22:30:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-167307fd-6df5-4052-a4d0-660e9e09cf13 req-c384c84f-e002-45bd-9f49-edb0842e78b9 tempest-TestServerVolumeAttachmentScenario-445206620 None] Deleting attachment b0e9cc51-bafc-44cf-9ae7-a1e2fad7791c. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "cinder-3550a58f-debb-4bb8-94a0-29a47ee3944e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "cinder-3550a58f-debb-4bb8-94a0-29a47ee3944e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "cinder-quobyte-3550a58f-debb-4bb8-94a0-29a47ee3944e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "cinder-quobyte-3550a58f-debb-4bb8-94a0-29a47ee3944e" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0565b959-0de6-4ef2-a69f-e4e32fab478c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:49 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e Nov 05 22:30:49 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:49 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e" returned: 0 in 0.347s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:49 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e Nov 05 22:30:49 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:49 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3550a58f-debb-4bb8-94a0-29a47ee3944e" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "cinder-quobyte-3550a58f-debb-4bb8-94a0-29a47ee3944e" released by "delete_volume" :: held 0.626s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Created reservations ['05bca548-7e39-4d48-80ce-e82044211150', '52685d2b-3056-427f-87e2-bb5951e1d250', '55166c48-a467-4647-89ef-0a65cd8f5971', '7a9c8640-a396-40da-8015-1f499b3f6df8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:49 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:30:49 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:50 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.245s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:30:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Deleted volume successfully. Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1fe24734-391d-4c23-b580-5e871094c2be tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "cinder-3550a58f-debb-4bb8-94a0-29a47ee3944e-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "cinder-544b514b-311e-4c3d-8fd0-75b4847ca89a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "cinder-544b514b-311e-4c3d-8fd0-75b4847ca89a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "cinder-quobyte-544b514b-311e-4c3d-8fd0-75b4847ca89a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "cinder-quobyte-544b514b-311e-4c3d-8fd0-75b4847ca89a" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1198f2-16be-4d88-a547-2fb443dbb36a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:50 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a Nov 05 22:30:50 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:50 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:50 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a Nov 05 22:30:50 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:50 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-544b514b-311e-4c3d-8fd0-75b4847ca89a" returned: 0 in 0.249s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "cinder-quobyte-544b514b-311e-4c3d-8fd0-75b4847ca89a" released by "delete_volume" :: held 0.639s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Created reservations ['671db6f4-909f-482d-a540-c31d0b03551f', '6362c8fc-2cde-4723-b24c-7ee88c7dd400', 'f6d919e2-d6ce-4baf-bcfa-3688adee0db5', '645cb18c-59e0-4c3c-a2f0-e1d6baa5eedf'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:51 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:30:51 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:51 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:51 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:30:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Deleted volume successfully. Nov 05 22:30:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d8dce2ab-1725-4a2c-80aa-50eaad4f8894 tempest-TestServerVolumeAttachmentScenario-445206620 None] Lock "cinder-544b514b-311e-4c3d-8fd0-75b4847ca89a-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:57 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:30:57 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:57 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:30:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:31:00 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=26,cinder:UPDATE=20,cinder:INSERT=4 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:31:01 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=25,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Flow 'volume_create_manager' (14d7728c-5bf2-4320-8816-ed99deeff85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ae9c15-be5a-45c8-b8cd-a499e659aee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ae9c15-be5a-45c8-b8cd-a499e659aee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1315588838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c17023a-c63a-47a9-964f-bb8a76638e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38add5dbffa4c578a8b2f1d8b9b9daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:22Z,use_quota=True,user_id='d3c662d4d8e9406e90ee32b86bba019c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c98e850-0478-4013-8aa8-96a3be2a44e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c98e850-0478-4013-8aa8-96a3be2a44e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89483a24-7176-4094-9a53-2e604e88030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89483a24-7176-4094-9a53-2e604e88030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c17023a-c63a-47a9-964f-bb8a76638e16', 'volume_name': 'volume-5c17023a-c63a-47a9-964f-bb8a76638e16', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a605b99-ee35-4415-97c1-ef97f65b4fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a605b99-ee35-4415-97c1-ef97f65b4fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059d2689-853b-480a-af33-825d35f120d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Volume 5c17023a-c63a-47a9-964f-bb8a76638e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c17023a-c63a-47a9-964f-bb8a76638e16', 'volume_size': 1} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1315588838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c17023a-c63a-47a9-964f-bb8a76638e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c38add5dbffa4c578a8b2f1d8b9b9daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:22Z,use_quota=True,user_id='d3c662d4d8e9406e90ee32b86bba019c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Creating volume 5c17023a-c63a-47a9-964f-bb8a76638e16 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:21 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:31:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:22 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 1073741824 Nov 05 22:31:22 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:22 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 1073741824" returned: 0 in 0.404s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:22 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 Nov 05 22:31:22 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:22 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059d2689-853b-480a-af33-825d35f120d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c17023a-c63a-47a9-964f-bb8a76638e16', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bdac31-6ccb-4bdc-abdc-2cbe7864be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Volume volume-5c17023a-c63a-47a9-964f-bb8a76638e16 (5c17023a-c63a-47a9-964f-bb8a76638e16): created successfully Nov 05 22:31:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bdac31-6ccb-4bdc-abdc-2cbe7864be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Flow 'volume_create_manager' (14d7728c-5bf2-4320-8816-ed99deeff85a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3acf2246-ddc8-4fad-bf47-e0a9cbc4d220 tempest-TestImageHashVerification-1765300623 None] Created volume successfully. Nov 05 22:31:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b838a9-c031-44fd-8035-58c63ef07309]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:23 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 Nov 05 22:31:23 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:23 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16" returned: 0 in 0.350s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce93e67-0775-4eb3-a549-8f7d1ebfb2c0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:24 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 Nov 05 22:31:24 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:24 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 /opt/stack/data/cinder/conversion/5c17023a-c63a-47a9-964f-bb8a76638e16.temp_image.0af4fbf6-4494-4240-8a04-85f242f36cf71eql5gkd.img {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:24 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 /opt/stack/data/cinder/conversion/5c17023a-c63a-47a9-964f-bb8a76638e16.temp_image.0af4fbf6-4494-4240-8a04-85f242f36cf71eql5gkd.img Nov 05 22:31:24 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:29 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 /opt/stack/data/cinder/conversion/5c17023a-c63a-47a9-964f-bb8a76638e16.temp_image.0af4fbf6-4494-4240-8a04-85f242f36cf71eql5gkd.img" returned: 0 in 5.534s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:29 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1c3771-b128-4777-9170-d79f4a2d3ca3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:29 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 Nov 05 22:31:29 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:30 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16" returned: 0 in 0.516s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:30 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/conversion/5c17023a-c63a-47a9-964f-bb8a76638e16.temp_image.0af4fbf6-4494-4240-8a04-85f242f36cf71eql5gkd.img {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:31:30 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Converted 1024.00 MB image at 184.99 MB/s Nov 05 22:31:30 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] 0af4fbf6-4494-4240-8a04-85f242f36cf7 was raw, no need to convert to raw {{(pid=87122) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 22:31:32 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:31:40 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:31:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.740s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Uploaded volume to glance image-id: 0af4fbf6-4494-4240-8a04-85f242f36cf7. {{(pid=87122) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 22:31:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-93b2ad35-f34b-4a24-9c04-ab1cd7589c03 tempest-TestImageHashVerification-1765300623 None] Copy volume to image completed successfully. Nov 05 22:31:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Acquiring lock "cinder-5c17023a-c63a-47a9-964f-bb8a76638e16-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Lock "cinder-5c17023a-c63a-47a9-964f-bb8a76638e16-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Acquiring lock "cinder-quobyte-5c17023a-c63a-47a9-964f-bb8a76638e16" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Lock "cinder-quobyte-5c17023a-c63a-47a9-964f-bb8a76638e16" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:48 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15c3a1f-2ead-4df2-a7b2-f8c8bb275d75]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:49 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 Nov 05 22:31:49 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:49 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16" returned: 0 in 0.343s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:49 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16 Nov 05 22:31:49 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:49 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5c17023a-c63a-47a9-964f-bb8a76638e16" returned: 0 in 0.239s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Lock "cinder-quobyte-5c17023a-c63a-47a9-964f-bb8a76638e16" released by "delete_volume" :: held 0.623s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Created reservations ['9bac3c47-7a06-4552-a4a2-7399dfe02329', '81adc3ec-bba9-40d4-a609-07d9e1d31116', '10877538-88a1-4055-a9f3-971b85f19441', '19316d87-9aa0-48a2-aafc-63d449d90e78'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:49 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:31:49 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:49 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Deleted volume successfully. Nov 05 22:31:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d7df1cc9-4abc-4f6d-8a9c-b46e903483d1 tempest-TestImageHashVerification-1765300623 None] Lock "cinder-5c17023a-c63a-47a9-964f-bb8a76638e16-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:57 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:31:57 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:57 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:31:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:31:59 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:31:59 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Flow 'volume_create_manager' (a32c8fb7-755f-4319-b94f-30c47c407587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3e9ed4-814a-443f-bc78-069848a88160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3e9ed4-814a-443f-bc78-069848a88160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-11226480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5600b2e14d46f99cac3a1f3685ddb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:32:20Z,use_quota=True,user_id='f46a473c077b43c584443869969740c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40eab78-1e77-435e-9eea-e076cf470b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40eab78-1e77-435e-9eea-e076cf470b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f64abd-ea57-41bc-80c7-37b6fe941b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f64abd-ea57-41bc-80c7-37b6fe941b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8', 'volume_name': 'volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c1f582-7012-4777-86bb-f16cfb6e71a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c1f582-7012-4777-86bb-f16cfb6e71a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ac3ca2-5980-41d7-b612-ea6bf3f52459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:19 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Volume 5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8', 'volume_size': 1} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-11226480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5600b2e14d46f99cac3a1f3685ddb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:32:20Z,use_quota=True,user_id='f46a473c077b43c584443869969740c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Creating volume 5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:32:19 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:32:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:19 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 1073741824 Nov 05 22:32:19 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:20 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 1073741824" returned: 0 in 0.443s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:20 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 Nov 05 22:32:20 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:20 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:32:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ac3ca2-5980-41d7-b612-ea6bf3f52459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a132d4c-e8ee-4689-a914-93d7a21ee87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:20 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Volume volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 (5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8): created successfully Nov 05 22:32:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a132d4c-e8ee-4689-a914-93d7a21ee87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:20 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Flow 'volume_create_manager' (a32c8fb7-755f-4319-b94f-30c47c407587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:32:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ed8ebb1a-9208-4bf1-a891-6f40f87d3e87 tempest-TestStampPattern-1500903774 None] Created volume successfully. Nov 05 22:32:30 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:32:30 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:32:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-44a028dc-f786-4d8b-bd6a-a30666a0ef3c req-7e6fe9b6-440d-4223-b8e3-264c0003242f tempest-TestStampPattern-1500903774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-44a028dc-f786-4d8b-bd6a-a30666a0ef3c req-7e6fe9b6-440d-4223-b8e3-264c0003242f tempest-TestStampPattern-1500903774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-44a028dc-f786-4d8b-bd6a-a30666a0ef3c req-7e6fe9b6-440d-4223-b8e3-264c0003242f tempest-TestStampPattern-1500903774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-44a028dc-f786-4d8b-bd6a-a30666a0ef3c req-7e6fe9b6-440d-4223-b8e3-264c0003242f tempest-TestStampPattern-1500903774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a04dc231-047c-4af8-891c-289a150a9bd7', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:32:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-44a028dc-f786-4d8b-bd6a-a30666a0ef3c req-7e6fe9b6-440d-4223-b8e3-264c0003242f tempest-TestStampPattern-1500903774 None] attachment_update completed successfully. Nov 05 22:32:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-5ee81797-024e-4462-96a0-9fd3205bda4a req-52ef9b8e-174a-44c8-b057-02a6b97913e0 tempest-TestStampPattern-1500903774 None] Terminate volume connection completed successfully. Nov 05 22:32:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-5ee81797-024e-4462-96a0-9fd3205bda4a req-52ef9b8e-174a-44c8-b057-02a6b97913e0 tempest-TestStampPattern-1500903774 None] Deleting attachment a04dc231-047c-4af8-891c-289a150a9bd7. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:32:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Creating offline snapshot 8b8ee3c9-b375-4f6a-9462-12e1d5121a7f of volume 5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:32:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7424f970-f8ab-4a63-bd7d-ee95c62fd9a1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:56 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 Nov 05 22:32:56 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:56 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" returned: 0 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:56 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f 1G Nov 05 22:32:56 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:56 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f 1G" returned: 0 in 0.374s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:56 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f Nov 05 22:32:56 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:57 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f" returned: 0 in 0.286s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:57 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f is being set with open permissions: ugo+rw Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:57 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f Nov 05 22:32:57 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:57 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:57 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.info Nov 05 22:32:57 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:57 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.info" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:57 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.info is being set with open permissions: ugo+rw Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:57 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.info Nov 05 22:32:57 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:57 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:32:57 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:57 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.info" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:57 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.245s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:32:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:32:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-98899ec9-2ea3-4167-a1f4-8ef187346d2b tempest-TestStampPattern-1500903774 None] Create snapshot completed successfully Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Flow 'volume_create_manager' (c3a3b4f4-8e48-4f65-932c-72c798ebc435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f39e4f-634a-401a-81f6-06f2f6eab114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f39e4f-634a-401a-81f6-06f2f6eab114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-53642639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff45919-258c-4388-afc3-22939b2e9336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5600b2e14d46f99cac3a1f3685ddb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b8ee3c9-b375-4f6a-9462-12e1d5121a7f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:05Z,use_quota=True,user_id='f46a473c077b43c584443869969740c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63e6fe4-7d7e-4010-9e71-250f956f384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63e6fe4-7d7e-4010-9e71-250f956f384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee73b824-9a6f-4b69-b8c5-f2cfe8ad9017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee73b824-9a6f-4b69-b8c5-f2cfe8ad9017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ff45919-258c-4388-afc3-22939b2e9336', 'volume_name': 'volume-6ff45919-258c-4388-afc3-22939b2e9336', 'volume_size': 1, 'snapshot_id': '8b8ee3c9-b375-4f6a-9462-12e1d5121a7f'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f7f241-f95a-4da7-a885-8478fffaa2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f7f241-f95a-4da7-a885-8478fffaa2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3867beb5-0be5-457f-bddd-6f32ed222e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:04 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Volume 6ff45919-258c-4388-afc3-22939b2e9336: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ff45919-258c-4388-afc3-22939b2e9336', 'volume_size': 1, 'snapshot_id': '8b8ee3c9-b375-4f6a-9462-12e1d5121a7f'} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Acquiring lock "cinder-quobyte-8b8ee3c9-b375-4f6a-9462-12e1d5121a7f-6ff45919-258c-4388-afc3-22939b2e9336" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-8b8ee3c9-b375-4f6a-9462-12e1d5121a7f-6ff45919-258c-4388-afc3-22939b2e9336" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Creating volume 6ff45919-258c-4388-afc3-22939b2e9336 from snapshot 8b8ee3c9-b375-4f6a-9462-12e1d5121a7f {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Acquiring lock "cinder-quobyte-6ff45919-258c-4388-afc3-22939b2e9336" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-6ff45919-258c-4388-afc3-22939b2e9336" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] snapshot: 8b8ee3c9-b375-4f6a-9462-12e1d5121a7f, volume: 6ff45919-258c-4388-afc3-22939b2e9336, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[838effc8-65c3-46a8-802e-ac54f326e4be]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:05 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f Nov 05 22:33:05 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:05 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:33:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b53e8c-29d0-4534-9962-53449073c41e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:05 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 Nov 05 22:33:05 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:05 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" returned: 0 in 0.375s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:33:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:33:05 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:33:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:05 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 Nov 05 22:33:05 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:14 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336" returned: 0 in 8.886s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:14 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:33:14 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Converted 1024.00 MB image at 115.22 MB/s Nov 05 22:33:14 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 is being set with open permissions: ugo+rw Nov 05 22:33:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:14 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 Nov 05 22:33:14 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:14 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:33:14 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=3,cinder:SELECT=14,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:33:14 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-6ff45919-258c-4388-afc3-22939b2e9336" released by "_copy_volume_from_snapshot" :: held 10.042s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-8b8ee3c9-b375-4f6a-9462-12e1d5121a7f-6ff45919-258c-4388-afc3-22939b2e9336" released by "_create_volume_from_snapshot" :: held 10.110s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.129s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3867beb5-0be5-457f-bddd-6f32ed222e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff45919-258c-4388-afc3-22939b2e9336', 'volume_size': 1, 'snapshot_id': '8b8ee3c9-b375-4f6a-9462-12e1d5121a7f'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08362d78-74d1-49c5-aab4-be44a30efb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Volume volume-6ff45919-258c-4388-afc3-22939b2e9336 (6ff45919-258c-4388-afc3-22939b2e9336): created successfully Nov 05 22:33:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08362d78-74d1-49c5-aab4-be44a30efb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Flow 'volume_create_manager' (c3a3b4f4-8e48-4f65-932c-72c798ebc435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8ce2e682-014f-443e-8df1-1c02bd958a99 tempest-TestStampPattern-1500903774 None] Created volume successfully. Nov 05 22:33:25 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:33:25 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:33:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-77912899-e20d-4f23-818d-bb7af5d012bd req-9ed80ab4-0966-4f1d-9ef2-d416537374af tempest-TestStampPattern-1500903774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-77912899-e20d-4f23-818d-bb7af5d012bd req-9ed80ab4-0966-4f1d-9ef2-d416537374af tempest-TestStampPattern-1500903774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [req-77912899-e20d-4f23-818d-bb7af5d012bd req-9ed80ab4-0966-4f1d-9ef2-d416537374af tempest-TestStampPattern-1500903774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-77912899-e20d-4f23-818d-bb7af5d012bd req-9ed80ab4-0966-4f1d-9ef2-d416537374af tempest-TestStampPattern-1500903774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041', 'name': 'volume-6ff45919-258c-4388-afc3-22939b2e9336', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21076bc7-9a39-4400-8979-299678d7e4e5', 'enforce_multipath': True} {{(pid=87122) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:33:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-77912899-e20d-4f23-818d-bb7af5d012bd req-9ed80ab4-0966-4f1d-9ef2-d416537374af tempest-TestStampPattern-1500903774 None] attachment_update completed successfully. Nov 05 22:33:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [req-488e45af-8d33-4cd4-93a0-c2483cde422b req-38f4eeb7-0db6-402f-89a8-681c83fd75f3 tempest-TestStampPattern-1500903774 None] Terminate volume connection completed successfully. Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [req-488e45af-8d33-4cd4-93a0-c2483cde422b req-38f4eeb7-0db6-402f-89a8-681c83fd75f3 tempest-TestStampPattern-1500903774 None] Deleting attachment 21076bc7-9a39-4400-8979-299678d7e4e5. {{(pid=87122) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:57 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:33:57 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:57 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.249s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:33:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:34:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Acquiring lock "cinder-6ff45919-258c-4388-afc3-22939b2e9336-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Lock "cinder-6ff45919-258c-4388-afc3-22939b2e9336-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Acquiring lock "cinder-quobyte-6ff45919-258c-4388-afc3-22939b2e9336" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-6ff45919-258c-4388-afc3-22939b2e9336" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:01 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf61527-2174-4d0c-8e39-cc2db302ffc5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:01 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 Nov 05 22:34:01 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:01 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336" returned: 0 in 0.380s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:01 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336 Nov 05 22:34:01 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:02 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6ff45919-258c-4388-afc3-22939b2e9336" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-6ff45919-258c-4388-afc3-22939b2e9336" released by "delete_volume" :: held 0.667s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Created reservations ['7aa5c466-0733-4155-a153-f90cf1ec9e38', '3818173a-30d0-486c-8a23-a33af19cf5e3', '5cb12183-befb-4633-a338-aabdad5f08d9', '42f731ad-461a-4d58-8eae-c440ef247e4d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:02 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:02 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:02 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Deleted volume successfully. Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ac62341-c2d0-400b-9550-34583aa30b7c tempest-TestStampPattern-1500903774 None] Lock "cinder-6ff45919-258c-4388-afc3-22939b2e9336-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Acquiring lock "cinder-8b8ee3c9-b375-4f6a-9462-12e1d5121a7f-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Lock "cinder-8b8ee3c9-b375-4f6a-9462-12e1d5121a7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Acquiring lock "cinder-quobyte-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Acquiring lock "cinder-quobyte-8b8ee3c9-b375-4f6a-9462-12e1d5121a7f" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-8b8ee3c9-b375-4f6a-9462-12e1d5121a7f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Deleting offline snapshot 8b8ee3c9-b375-4f6a-9462-12e1d5121a7f of volume 5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] snapshot_file for this snap is: volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee771d8-d8ab-474f-8a34-c1dba0e69b08]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:03 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f Nov 05 22:34:03 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:03 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f" returned: 0 in 0.342s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5172d0ce-129b-41c8-bd21-a6f1fcbb2de4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:03 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 Nov 05 22:34:03 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:03 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" returned: 0 in 0.513s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:03 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f Nov 05 22:34:03 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:04 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f" returned: 0 in 0.311s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:04 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f Nov 05 22:34:04 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:04 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8.8b8ee3c9-b375-4f6a-9462-12e1d5121a7f" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-8b8ee3c9-b375-4f6a-9462-12e1d5121a7f" released by "_delete_snapshot" :: held 1.504s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" released by "delete_snapshot" :: held 1.525s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:04 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Created reservations ['da38683a-598a-4e14-92fa-998dc3bb7ebb', '0face3d6-0ebb-4c7f-94c9-0a1a5f311f8e', '1b5e4f8f-650a-404a-afb9-31e189b98a6a', '5ec27292-97ce-4c73-bc2f-a1830de83cfd'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Delete snapshot completed successfully. Nov 05 22:34:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e4e99762-365d-4541-9145-c5bc7df949ac tempest-TestStampPattern-1500903774 None] Lock "cinder-8b8ee3c9-b375-4f6a-9462-12e1d5121a7f-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Acquiring lock "cinder-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Lock "cinder-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Acquiring lock "cinder-quobyte-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaab57de-5ebf-4c77-b8f2-8747dd95654b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:08 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 Nov 05 22:34:08 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:08 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:08 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8 Nov 05 22:34:08 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:09 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Lock "cinder-quobyte-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8" released by "delete_volume" :: held 0.661s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Created reservations ['942a9740-e74c-4945-96eb-828787f0984e', 'eabe4895-ba7a-4f10-9142-9a9a17af214b', '4f0043d3-6b65-4784-be57-fcd68febd041', '6c308ccf-2eb0-4fc9-95e0-e9928661c35e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:09 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:09 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:09 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Deleted volume successfully. Nov 05 22:34:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9febac55-2f1b-4937-80cb-47a7e361a844 tempest-TestStampPattern-1500903774 None] Lock "cinder-5daf4c5a-5c0c-446f-93e7-9d9b7d768ec8-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:19 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=6 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:34:19 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (0f482508-5161-4e50-bbde-bd64865a5fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815d6d50-3e81-4d52-88d7-c1ce0299ef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815d6d50-3e81-4d52-88d7-c1ce0299ef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-596200139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7acf677b-c8ef-42f7-9bb6-f201babdb952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:21Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e9837d-2018-4a08-b44b-11f0fb4da44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e9837d-2018-4a08-b44b-11f0fb4da44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe37b07-ef9b-454d-980e-238ec5d6051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe37b07-ef9b-454d-980e-238ec5d6051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7acf677b-c8ef-42f7-9bb6-f201babdb952', 'volume_name': 'volume-7acf677b-c8ef-42f7-9bb6-f201babdb952', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846c337a-0762-4911-ba4d-cb75f4098248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846c337a-0762-4911-ba4d-cb75f4098248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dcb4d0-4853-450f-bac6-a4bea792c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:21 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume 7acf677b-c8ef-42f7-9bb6-f201babdb952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7acf677b-c8ef-42f7-9bb6-f201babdb952', 'volume_size': 1} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-596200139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7acf677b-c8ef-42f7-9bb6-f201babdb952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:21Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Creating volume 7acf677b-c8ef-42f7-9bb6-f201babdb952 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:21 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:21 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 1073741824 Nov 05 22:34:21 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:21 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 1073741824" returned: 0 in 0.420s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:21 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 Nov 05 22:34:21 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:22 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1dcb4d0-4853-450f-bac6-a4bea792c37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7acf677b-c8ef-42f7-9bb6-f201babdb952', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576848a1-7d41-478a-82fe-e9ae48d7c9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 (7acf677b-c8ef-42f7-9bb6-f201babdb952): created successfully Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576848a1-7d41-478a-82fe-e9ae48d7c9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (0f482508-5161-4e50-bbde-bd64865a5fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aa66f6ef-7a2b-42aa-ba2a-3cf595428025 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created volume successfully. Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Creating offline snapshot 82382c97-1a72-4f1a-852d-9546b4c2b86e of volume 7acf677b-c8ef-42f7-9bb6-f201babdb952 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf6d13c-1c3b-4f1e-abd9-253a78b9a9d6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:22 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 Nov 05 22:34:22 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:22 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:22 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e 1G Nov 05 22:34:22 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:23 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e 1G" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:23 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e Nov 05 22:34:23 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:23 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e" returned: 0 in 0.293s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:23 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e is being set with open permissions: ugo+rw Nov 05 22:34:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:23 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e Nov 05 22:34:23 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:23 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e" returned: 0 in 0.238s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:23 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.info Nov 05 22:34:23 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:24 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.info" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:24 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.info is being set with open permissions: ugo+rw Nov 05 22:34:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:24 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.info Nov 05 22:34:24 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:24 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.info" returned: 0 in 0.232s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-cfbe8ef0-c43d-450c-b08c-b1dcbb7819a6 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Create snapshot completed successfully Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (84af06b9-3f09-4381-99e9-3e3eac8de740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4aca255-347f-433e-99d0-1c153ad04f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4aca255-347f-433e-99d0-1c153ad04f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-994509469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924cb06c-75be-4735-97aa-c0518780bd46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:25Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1481636-6005-4ea9-9ecf-c01e7feb3e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1481636-6005-4ea9-9ecf-c01e7feb3e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1db91c-c8eb-4c65-be82-87b16bd067c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1db91c-c8eb-4c65-be82-87b16bd067c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924cb06c-75be-4735-97aa-c0518780bd46', 'volume_name': 'volume-924cb06c-75be-4735-97aa-c0518780bd46', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481e1def-bf96-4a21-9c61-a95050e4149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481e1def-bf96-4a21-9c61-a95050e4149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f306910f-4369-4a5d-99e6-2fc12a518766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume 924cb06c-75be-4735-97aa-c0518780bd46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924cb06c-75be-4735-97aa-c0518780bd46', 'volume_size': 1} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-994509469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924cb06c-75be-4735-97aa-c0518780bd46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:25Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Creating volume 924cb06c-75be-4735-97aa-c0518780bd46 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:25 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:25 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46 1073741824 Nov 05 22:34:25 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (fc398a73-1cc7-40c4-975c-13505863c912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa130cf8-c125-4024-83fc-4c8c9f594213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa130cf8-c125-4024-83fc-4c8c9f594213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-45265205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f29796a-5851-408e-841f-a22a0cab6c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:25Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e6cf17-87af-4bc5-b4ab-a831b5cb08e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e6cf17-87af-4bc5-b4ab-a831b5cb08e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565bfa66-8104-44cf-9b7b-d76f1785047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565bfa66-8104-44cf-9b7b-d76f1785047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f29796a-5851-408e-841f-a22a0cab6c89', 'volume_name': 'volume-4f29796a-5851-408e-841f-a22a0cab6c89', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444fb114-e223-4fab-aeb5-7d4e2c4839d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444fb114-e223-4fab-aeb5-7d4e2c4839d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dea1a1a-0495-4b1e-973a-43b81b4ce26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume 4f29796a-5851-408e-841f-a22a0cab6c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f29796a-5851-408e-841f-a22a0cab6c89', 'volume_size': 1} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:25 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46 1073741824" returned: 0 in 0.521s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:25 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46 Nov 05 22:34:25 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (fb413f4f-b36a-4817-bfa5-56769cb79755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88027279-c9ea-4561-b7e0-d46559cc5c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88027279-c9ea-4561-b7e0-d46559cc5c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-89541155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cf24cd-3134-4d92-8f89-6630a41fd1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:26Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c640b1-83ca-4713-a0e9-d5c54445e881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c640b1-83ca-4713-a0e9-d5c54445e881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95274ccf-7aee-48a9-853f-61afe737b291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95274ccf-7aee-48a9-853f-61afe737b291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53cf24cd-3134-4d92-8f89-6630a41fd1cc', 'volume_name': 'volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60bef72-3dc3-4e8f-8f44-336eadbb1db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60bef72-3dc3-4e8f-8f44-336eadbb1db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8d8867-2c97-43e0-a3a9-98327a78820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume 53cf24cd-3134-4d92-8f89-6630a41fd1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc', 'volume_size': 1} Nov 05 22:34:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:26 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-45265205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f29796a-5851-408e-841f-a22a0cab6c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:25Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Creating volume 4f29796a-5851-408e-841f-a22a0cab6c89 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:26 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f306910f-4369-4a5d-99e6-2fc12a518766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924cb06c-75be-4735-97aa-c0518780bd46', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d90d09-bf57-4691-93df-c289a0d0f007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89 1073741824 Nov 05 22:34:26 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume volume-924cb06c-75be-4735-97aa-c0518780bd46 (924cb06c-75be-4735-97aa-c0518780bd46): created successfully Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d90d09-bf57-4691-93df-c289a0d0f007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (84af06b9-3f09-4381-99e9-3e3eac8de740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-47716d87-57f7-47d8-9c55-540bcccdb635 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created volume successfully. Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (4c3e1380-4842-417f-a9be-d5a03e0239f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5dd76b9-4ace-4eec-ae55-a4f617e21c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5dd76b9-4ace-4eec-ae55-a4f617e21c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-460244786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac89d8a-af01-4a53-8e97-7f54d0ce11e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:26Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5966c4bf-889c-4e2f-b4f8-ef1ef06586fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5966c4bf-889c-4e2f-b4f8-ef1ef06586fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6962563a-a0d7-4ba1-a414-42a617606720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6962563a-a0d7-4ba1-a414-42a617606720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac89d8a-af01-4a53-8e97-7f54d0ce11e4', 'volume_name': 'volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15153f76-faf2-457e-9b0a-8ad97fa33c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15153f76-faf2-457e-9b0a-8ad97fa33c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3669abd7-eb9c-4504-8db2-0f877a705ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume 7ac89d8a-af01-4a53-8e97-7f54d0ce11e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4', 'volume_size': 1} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:26 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89 1073741824" returned: 0 in 0.497s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:26 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89 Nov 05 22:34:26 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (fa4a95a3-2153-46cd-9066-30db9f9a03e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a631a58-c9d3-46e7-8522-5680d3c0c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a631a58-c9d3-46e7-8522-5680d3c0c403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912597217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9b6840-955f-4a95-a53f-05435e3c9769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:27Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b95fd78-3f51-409d-a30f-2a752db78fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b95fd78-3f51-409d-a30f-2a752db78fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9f3c2c-edc4-481a-96f5-ca518c2664fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9f3c2c-edc4-481a-96f5-ca518c2664fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9b6840-955f-4a95-a53f-05435e3c9769', 'volume_name': 'volume-9b9b6840-955f-4a95-a53f-05435e3c9769', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84a67f2-52be-400f-910e-861d6a05f639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84a67f2-52be-400f-910e-861d6a05f639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f170203c-c055-4e62-9494-e38a3d6a0b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume 9b9b6840-955f-4a95-a53f-05435e3c9769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9b6840-955f-4a95-a53f-05435e3c9769', 'volume_size': 1} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:26 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89" returned: 0 in 0.243s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-89541155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cf24cd-3134-4d92-8f89-6630a41fd1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:26Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Creating volume 53cf24cd-3134-4d92-8f89-6630a41fd1cc {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:26 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dea1a1a-0495-4b1e-973a-43b81b4ce26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f29796a-5851-408e-841f-a22a0cab6c89', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12520599-1aef-4df2-8a15-1050dd72fe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc 1073741824 Nov 05 22:34:26 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume volume-4f29796a-5851-408e-841f-a22a0cab6c89 (4f29796a-5851-408e-841f-a22a0cab6c89): created successfully Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12520599-1aef-4df2-8a15-1050dd72fe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (fc398a73-1cc7-40c4-975c-13505863c912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:26 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-22c2b754-1793-41cf-a16a-00886b075e58 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created volume successfully. Nov 05 22:34:27 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc 1073741824" returned: 0 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:27 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc Nov 05 22:34:27 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:27 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc" returned: 0 in 0.235s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-460244786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac89d8a-af01-4a53-8e97-7f54d0ce11e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:26Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Creating volume 7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:27 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8d8867-2c97-43e0-a3a9-98327a78820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:27 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 1073741824 Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0214b144-428a-4754-b88b-558e0c90f254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:27 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:27 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc (53cf24cd-3134-4d92-8f89-6630a41fd1cc): created successfully Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0214b144-428a-4754-b88b-558e0c90f254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (fb413f4f-b36a-4817-bfa5-56769cb79755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-45e88979-7e44-4e76-aff8-1aede0f47152 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created volume successfully. Nov 05 22:34:27 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 1073741824" returned: 0 in 0.435s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:27 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 Nov 05 22:34:27 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:28 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4" returned: 0 in 0.249s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-912597217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9b6840-955f-4a95-a53f-05435e3c9769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc005f4d3a7429da8106282d0a23b04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:27Z,use_quota=True,user_id='5f8998c698f5423ab0f5edcdf7be373e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Creating volume 9b9b6840-955f-4a95-a53f-05435e3c9769 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:28 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3669abd7-eb9c-4504-8db2-0f877a705ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e91dcaf-8e30-48d8-9ed1-302578c7a987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:28 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769 1073741824 Nov 05 22:34:28 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 (7ac89d8a-af01-4a53-8e97-7f54d0ce11e4): created successfully Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e91dcaf-8e30-48d8-9ed1-302578c7a987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (4c3e1380-4842-417f-a9be-d5a03e0239f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3f663c49-a670-4d5c-a612-c2765712ad85 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created volume successfully. Nov 05 22:34:28 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769 1073741824" returned: 0 in 0.410s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:28 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769 Nov 05 22:34:28 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:28 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769" returned: 0 in 0.238s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f170203c-c055-4e62-9494-e38a3d6a0b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9b6840-955f-4a95-a53f-05435e3c9769', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0f657b-055e-44d0-84ba-a80597b3b874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:28 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Volume volume-9b9b6840-955f-4a95-a53f-05435e3c9769 (9b9b6840-955f-4a95-a53f-05435e3c9769): created successfully Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0f657b-055e-44d0-84ba-a80597b3b874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:28 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Flow 'volume_create_manager' (fa4a95a3-2153-46cd-9066-30db9f9a03e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8df288f3-183b-482e-bc3c-56fa573b425d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created volume successfully. Nov 05 22:34:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-9b9b6840-955f-4a95-a53f-05435e3c9769-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-9b9b6840-955f-4a95-a53f-05435e3c9769-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-quobyte-9b9b6840-955f-4a95-a53f-05435e3c9769" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-9b9b6840-955f-4a95-a53f-05435e3c9769" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1319b3d-4bc4-404b-940f-62fc2b80dd1c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:30 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769 Nov 05 22:34:30 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:30 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769" returned: 0 in 0.354s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:30 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769 Nov 05 22:34:30 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:30 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-9b9b6840-955f-4a95-a53f-05435e3c9769" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-9b9b6840-955f-4a95-a53f-05435e3c9769" released by "delete_volume" :: held 0.634s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created reservations ['ffd42f76-39f2-43c7-b8f4-ea283483188b', 'efc14978-1f01-4a73-bce7-8ad1ba2d7558', '016c5b26-a55d-4fef-be1a-1dd74511f307', '8398c9c7-b07a-472a-bdf4-ac88578827ed'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:30 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:30 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:31 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:31 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Deleted volume successfully. Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c3d4f5f0-7b29-4a1e-91d5-77d156968169 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-9b9b6840-955f-4a95-a53f-05435e3c9769-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-quobyte-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a65bd45-43ab-4d1e-ad6d-33082cfe365f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:31 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 Nov 05 22:34:31 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:31 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:31 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4 Nov 05 22:34:31 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:31 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4" returned: 0 in 0.245s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4" released by "delete_volume" :: held 0.650s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created reservations ['ebb16cac-eb5d-4e76-8451-4c26762dff99', 'abe0b2e8-1d0d-434a-84c9-63b84cf0ffca', '420a9f0f-bd7d-4bc5-8e88-b7029a6a0700', 'a51a7ce1-f568-428f-8791-b137c57ca275'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:31 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:31 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:32 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.246s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Deleted volume successfully. Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7bc8ccc4-cda3-4b9d-a0ee-e7eb674be779 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-7ac89d8a-af01-4a53-8e97-7f54d0ce11e4-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-53cf24cd-3134-4d92-8f89-6630a41fd1cc-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-53cf24cd-3134-4d92-8f89-6630a41fd1cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-quobyte-53cf24cd-3134-4d92-8f89-6630a41fd1cc" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-53cf24cd-3134-4d92-8f89-6630a41fd1cc" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e2d035-277d-49fe-9239-e9bc61fd6744]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:32 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc Nov 05 22:34:32 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:32 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc" returned: 0 in 0.385s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:32 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc Nov 05 22:34:32 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:32 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-53cf24cd-3134-4d92-8f89-6630a41fd1cc" returned: 0 in 0.238s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-53cf24cd-3134-4d92-8f89-6630a41fd1cc" released by "delete_volume" :: held 0.664s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created reservations ['aaf705b0-3cf6-459d-9df6-5b4eb8966c35', 'b041ffe9-aee3-4e80-b166-d06fbf40b2b8', 'f55b7692-9fe0-4197-96d6-216de42b8d9f', 'bb1c0368-2190-444c-97e9-4d88b1660866'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:33 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:33 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:33 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Deleted volume successfully. Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d5385f34-4b9e-4836-bf83-81ac09c0578d tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-53cf24cd-3134-4d92-8f89-6630a41fd1cc-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-4f29796a-5851-408e-841f-a22a0cab6c89-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-4f29796a-5851-408e-841f-a22a0cab6c89-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-quobyte-4f29796a-5851-408e-841f-a22a0cab6c89" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-4f29796a-5851-408e-841f-a22a0cab6c89" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2587f027-481c-45fc-853f-99ae11bd8bca]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:33 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89 Nov 05 22:34:33 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:33 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:33 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89 Nov 05 22:34:33 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:34 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4f29796a-5851-408e-841f-a22a0cab6c89" returned: 0 in 0.262s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-4f29796a-5851-408e-841f-a22a0cab6c89" released by "delete_volume" :: held 0.674s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created reservations ['8c4f1be1-64b6-4c8f-8080-dd521377f5ed', 'f386da49-aef8-402a-8694-28863f970dd7', '34735314-cb34-4496-beec-4d5dc64fc80c', '7e65d54f-ed2a-474e-a02d-b159b40d191f'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:34 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:34 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:34 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.241s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Deleted volume successfully. Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-01f4dd32-a559-4906-9e38-64bf9a997f2f tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-4f29796a-5851-408e-841f-a22a0cab6c89-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-924cb06c-75be-4735-97aa-c0518780bd46-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-924cb06c-75be-4735-97aa-c0518780bd46-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-quobyte-924cb06c-75be-4735-97aa-c0518780bd46" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-924cb06c-75be-4735-97aa-c0518780bd46" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e9f572-1bb3-4b80-8a44-4aa6ee206901]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:34 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46 Nov 05 22:34:34 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:35 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46" returned: 0 in 0.357s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:35 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46 Nov 05 22:34:35 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:35 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-924cb06c-75be-4735-97aa-c0518780bd46" returned: 0 in 0.233s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-924cb06c-75be-4735-97aa-c0518780bd46" released by "delete_volume" :: held 0.628s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created reservations ['bd264923-8212-4861-b59b-77158543edab', '7260d528-0dd0-40a7-abda-5d25a8581154', '0382ccff-5561-4430-8198-0e959587f5d3', 'f2a00d80-303f-42cb-9b9d-aa1d87051c13'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:35 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:35 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:35 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.235s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Deleted volume successfully. Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-3bd0351d-20c8-43f4-83e0-1ee6629c88d1 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-924cb06c-75be-4735-97aa-c0518780bd46-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-82382c97-1a72-4f1a-852d-9546b4c2b86e-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-82382c97-1a72-4f1a-852d-9546b4c2b86e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-quobyte-7acf677b-c8ef-42f7-9bb6-f201babdb952" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-7acf677b-c8ef-42f7-9bb6-f201babdb952" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-quobyte-82382c97-1a72-4f1a-852d-9546b4c2b86e" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-82382c97-1a72-4f1a-852d-9546b4c2b86e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Deleting offline snapshot 82382c97-1a72-4f1a-852d-9546b4c2b86e of volume 7acf677b-c8ef-42f7-9bb6-f201babdb952 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] snapshot_file for this snap is: volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[833daf58-6497-46c5-83dd-66abd1d85df0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:35 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e Nov 05 22:34:35 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:36 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e" returned: 0 in 0.360s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7acf677b-c8ef-42f7-9bb6-f201babdb952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f53b34-9722-4df7-8e33-8aebb57902db]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:36 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 Nov 05 22:34:36 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:36 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:36 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e Nov 05 22:34:36 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:36 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e" returned: 0 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:36 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e Nov 05 22:34:36 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:37 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952.82382c97-1a72-4f1a-852d-9546b4c2b86e" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-82382c97-1a72-4f1a-852d-9546b4c2b86e" released by "_delete_snapshot" :: held 1.382s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-7acf677b-c8ef-42f7-9bb6-f201babdb952" released by "delete_snapshot" :: held 1.403s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:37 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created reservations ['dc790126-918b-4c3e-b3c6-ca81831d2084', 'a6d66ee5-7c69-44b6-af33-f77ff71ffe61', 'ecf60784-8aa6-472f-a2f1-fa2c9fe55cb8', 'be18c7fe-67b3-49e0-b8cd-b923eea0e370'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Delete snapshot completed successfully. Nov 05 22:34:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c634264-b84e-47d9-9fbb-165d09011abf tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-82382c97-1a72-4f1a-852d-9546b4c2b86e-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-7acf677b-c8ef-42f7-9bb6-f201babdb952-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-7acf677b-c8ef-42f7-9bb6-f201babdb952-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "cinder-quobyte-7acf677b-c8ef-42f7-9bb6-f201babdb952" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-7acf677b-c8ef-42f7-9bb6-f201babdb952" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2435a3-a4e0-4b35-ac0e-0c4716f871fb]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:38 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 Nov 05 22:34:38 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:38 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952" returned: 0 in 0.358s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:38 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952 Nov 05 22:34:38 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:38 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7acf677b-c8ef-42f7-9bb6-f201babdb952" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-quobyte-7acf677b-c8ef-42f7-9bb6-f201babdb952" released by "delete_volume" :: held 0.658s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Created reservations ['5aa7c362-71ff-4713-857b-691a2153b15e', 'f0a20596-09b0-47b4-b06b-8d6946064808', '25571391-714e-407f-be39-456d4755d800', 'cefc591e-9420-433f-a109-888465daae3b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:38 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:38 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:38 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.234s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:38 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Deleted volume successfully. Nov 05 22:34:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ad57e899-7c84-464d-9b8d-55b3293735b9 tempest-CreateVolumesFromSnapshotTest-1557967524 None] Lock "cinder-7acf677b-c8ef-42f7-9bb6-f201babdb952-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Flow 'volume_create_manager' (6b417d07-5594-4217-8759-1a69594f238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fbb74a-a575-44d6-b531-f1cb2f15dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fbb74a-a575-44d6-b531-f1cb2f15dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1864649675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db57cb45-51d5-4fc0-9dbb-13d6c7b24211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a340562ad6964e13a4a02be4c266f7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:42Z,use_quota=True,user_id='f8e16662ee8a45b6bb4e63d759312517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8249e50-b7fc-40a7-8476-da05d6f222d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8249e50-b7fc-40a7-8476-da05d6f222d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d13f8e-b0f3-4ec5-9837-6f1f8605f565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d13f8e-b0f3-4ec5-9837-6f1f8605f565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db57cb45-51d5-4fc0-9dbb-13d6c7b24211', 'volume_name': 'volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2922d8a7-24b8-48bb-b28f-d59b54d6e603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2922d8a7-24b8-48bb-b28f-d59b54d6e603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0a953a-d83a-471f-9bff-25b89e12552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:41 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Volume db57cb45-51d5-4fc0-9dbb-13d6c7b24211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211', 'volume_size': 1} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1864649675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db57cb45-51d5-4fc0-9dbb-13d6c7b24211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a340562ad6964e13a4a02be4c266f7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:42Z,use_quota=True,user_id='f8e16662ee8a45b6bb4e63d759312517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Creating volume db57cb45-51d5-4fc0-9dbb-13d6c7b24211 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:41 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:34:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:41 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 1073741824 Nov 05 22:34:41 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:42 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 1073741824" returned: 0 in 0.395s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:42 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 Nov 05 22:34:42 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:42 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0a953a-d83a-471f-9bff-25b89e12552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb8a393-8b64-4a94-9924-df1be3fbd9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Volume volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 (db57cb45-51d5-4fc0-9dbb-13d6c7b24211): created successfully Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb8a393-8b64-4a94-9924-df1be3fbd9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Flow 'volume_create_manager' (6b417d07-5594-4217-8759-1a69594f238e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-40479371-9a03-4152-b7c8-23d8946f099b tempest-VolumeDependencyTests-1884348789 None] Created volume successfully. Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Creating offline snapshot 1378b09b-e5e6-4e35-9855-7e6390538c4e of volume db57cb45-51d5-4fc0-9dbb-13d6c7b24211 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d7b900-be6c-479d-ac1b-b2ad266d6108]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:43 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 Nov 05 22:34:43 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:43 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" returned: 0 in 0.354s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:43 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e 1G Nov 05 22:34:43 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:43 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e 1G" returned: 0 in 0.409s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:43 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e Nov 05 22:34:43 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:43 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:43 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e is being set with open permissions: ugo+rw Nov 05 22:34:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:43 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e Nov 05 22:34:43 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:44 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e" returned: 0 in 0.232s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:44 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.info Nov 05 22:34:44 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:44 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.info" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:44 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.info is being set with open permissions: ugo+rw Nov 05 22:34:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:44 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.info Nov 05 22:34:44 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:44 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.info" returned: 0 in 0.241s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ddd20df9-b45b-4333-a110-5589177a4b2e tempest-VolumeDependencyTests-1884348789 None] Create snapshot completed successfully Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Flow 'volume_create_manager' (ee4d890d-6fcf-4e29-9c5d-75f4459731f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0357de-9ef5-4350-bb2d-56f19721f139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0357de-9ef5-4350-bb2d-56f19721f139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-49490565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec30a64d-b5f4-4adf-95f2-f9173704a71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a340562ad6964e13a4a02be4c266f7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1378b09b-e5e6-4e35-9855-7e6390538c4e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:45Z,use_quota=True,user_id='f8e16662ee8a45b6bb4e63d759312517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7da4a96-c6ba-46ad-8d33-fb668e1047dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7da4a96-c6ba-46ad-8d33-fb668e1047dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b231eeb-5747-42d6-8479-9c5c4e6fbe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b231eeb-5747-42d6-8479-9c5c4e6fbe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec30a64d-b5f4-4adf-95f2-f9173704a71f', 'volume_name': 'volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f', 'volume_size': 1, 'snapshot_id': '1378b09b-e5e6-4e35-9855-7e6390538c4e'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5593a4b5-bb30-49b5-8c21-fd4782f9c4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5593a4b5-bb30-49b5-8c21-fd4782f9c4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9b580e-f56a-483b-b261-ba06b5226457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:45 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Volume ec30a64d-b5f4-4adf-95f2-f9173704a71f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f', 'volume_size': 1, 'snapshot_id': '1378b09b-e5e6-4e35-9855-7e6390538c4e'} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "cinder-quobyte-1378b09b-e5e6-4e35-9855-7e6390538c4e-ec30a64d-b5f4-4adf-95f2-f9173704a71f" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-1378b09b-e5e6-4e35-9855-7e6390538c4e-ec30a64d-b5f4-4adf-95f2-f9173704a71f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Creating volume ec30a64d-b5f4-4adf-95f2-f9173704a71f from snapshot 1378b09b-e5e6-4e35-9855-7e6390538c4e {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "cinder-quobyte-ec30a64d-b5f4-4adf-95f2-f9173704a71f" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-ec30a64d-b5f4-4adf-95f2-f9173704a71f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] snapshot: 1378b09b-e5e6-4e35-9855-7e6390538c4e, volume: ec30a64d-b5f4-4adf-95f2-f9173704a71f, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadf3929-a0c4-4cd5-839d-e2c078827713]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:45 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e Nov 05 22:34:45 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:46 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e" returned: 0 in 0.367s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bafdbb7-a9c2-4237-a251-a36e0d8e9411]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:46 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 Nov 05 22:34:46 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:46 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" returned: 0 in 0.354s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:34:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:34:46 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:34:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:46 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f Nov 05 22:34:46 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:52 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f" returned: 0 in 5.759s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:34:52 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Converted 1024.00 MB image at 177.76 MB/s Nov 05 22:34:52 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f is being set with open permissions: ugo+rw Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:52 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f Nov 05 22:34:52 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:52 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f" returned: 0 in 0.232s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-ec30a64d-b5f4-4adf-95f2-f9173704a71f" released by "_copy_volume_from_snapshot" :: held 6.795s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-1378b09b-e5e6-4e35-9855-7e6390538c4e-ec30a64d-b5f4-4adf-95f2-f9173704a71f" released by "_create_volume_from_snapshot" :: held 6.856s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.873s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9b580e-f56a-483b-b261-ba06b5226457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f', 'volume_size': 1, 'snapshot_id': '1378b09b-e5e6-4e35-9855-7e6390538c4e'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4270e02b-5acd-4613-9a72-12fd6a009e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:52 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Volume volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f (ec30a64d-b5f4-4adf-95f2-f9173704a71f): created successfully Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4270e02b-5acd-4613-9a72-12fd6a009e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:52 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Flow 'volume_create_manager' (ee4d890d-6fcf-4e29-9c5d-75f4459731f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:52 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8d2c3813-ec7a-472f-bf15-18a1dfec1bdb tempest-VolumeDependencyTests-1884348789 None] Created volume successfully. Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "cinder-1378b09b-e5e6-4e35-9855-7e6390538c4e-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-1378b09b-e5e6-4e35-9855-7e6390538c4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "cinder-quobyte-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "cinder-quobyte-1378b09b-e5e6-4e35-9855-7e6390538c4e" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-1378b09b-e5e6-4e35-9855-7e6390538c4e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Deleting offline snapshot 1378b09b-e5e6-4e35-9855-7e6390538c4e of volume db57cb45-51d5-4fc0-9dbb-13d6c7b24211 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] snapshot_file for this snap is: volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bdd865-b096-4370-9a0f-832e90a7ac53]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:53 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e Nov 05 22:34:53 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:53 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e" returned: 0 in 0.341s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[765921d1-8f59-47b8-885e-faf4c92eb279]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:53 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 Nov 05 22:34:53 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:53 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" returned: 0 in 0.517s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:54 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e Nov 05 22:34:54 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:54 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e" returned: 0 in 0.340s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:54 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e Nov 05 22:34:54 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:54 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211.1378b09b-e5e6-4e35-9855-7e6390538c4e" returned: 0 in 0.236s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-1378b09b-e5e6-4e35-9855-7e6390538c4e" released by "_delete_snapshot" :: held 1.533s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" released by "delete_snapshot" :: held 1.555s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Created reservations ['421a2af3-3c0e-450a-a8cc-af749054870f', '75879624-51c6-448f-bb3e-d847359eba24', '42923ea6-0f81-43aa-9397-56eaea99783a', '74ce5c0e-f976-4359-9139-da41d8123568'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Delete snapshot completed successfully. Nov 05 22:34:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-aea1a1e5-295d-4510-9114-416b3dbeb67c tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-1378b09b-e5e6-4e35-9855-7e6390538c4e-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "cinder-db57cb45-51d5-4fc0-9dbb-13d6c7b24211-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-db57cb45-51d5-4fc0-9dbb-13d6c7b24211-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "cinder-quobyte-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" acquired by "delete_volume" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b83bd8-b4bd-49d4-ada0-b290db8bd8ac]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:55 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 Nov 05 22:34:55 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:55 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:55 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211 Nov 05 22:34:55 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:55 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-db57cb45-51d5-4fc0-9dbb-13d6c7b24211" released by "delete_volume" :: held 0.646s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Created reservations ['204591a2-c6f2-4cd4-bd48-f876e2599596', '821230fe-7314-4620-9429-e18a37625231', 'db7ad26b-38bb-49d4-9c74-f75024bea3c0', 'b5dfec11-70fd-40f7-8244-41effc1368fc'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:56 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:56 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:56 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.238s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Deleted volume successfully. Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-249f2450-ffea-4c1b-8c74-c51ee389ec41 tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-db57cb45-51d5-4fc0-9dbb-13d6c7b24211-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "cinder-ec30a64d-b5f4-4adf-95f2-f9173704a71f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-ec30a64d-b5f4-4adf-95f2-f9173704a71f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "cinder-quobyte-ec30a64d-b5f4-4adf-95f2-f9173704a71f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-ec30a64d-b5f4-4adf-95f2-f9173704a71f" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a3a595-affa-432f-b3c5-3a3ef43ffeb1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:56 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f Nov 05 22:34:56 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:56 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:56 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f Nov 05 22:34:56 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:57 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ec30a64d-b5f4-4adf-95f2-f9173704a71f" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-quobyte-ec30a64d-b5f4-4adf-95f2-f9173704a71f" released by "delete_volume" :: held 0.628s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Created reservations ['2e1883f4-e50e-41fd-80de-03bdba5d6b92', '439faf84-5a17-4c98-ad58-50dae85b4d6d', 'ad3b9a8e-4769-4997-b163-9b03e26c601a', 'b0850022-ac92-49d0-89fc-63dccecc3fd8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:57 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:57 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:57 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.243s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Deleted volume successfully. Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8da2e132-dcea-42a2-93db-e92d417c661e tempest-VolumeDependencyTests-1884348789 None] Lock "cinder-ec30a64d-b5f4-4adf-95f2-f9173704a71f-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:57 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:34:57 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:57 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:34:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Flow 'volume_create_manager' (a300ca27-dc70-4549-9dce-ca43546d4375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ae13a1-9ed1-4496-89de-e5ac02f383ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ae13a1-9ed1-4496-89de-e5ac02f383ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbbfb29-226b-43e2-808d-1c948d024726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd6263f62c6439ea741e02d866209ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:02Z,use_quota=True,user_id='31af989af74e4693b93ac6a4b1e7e602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0762caa-9ac9-40f8-aa43-59a2f129476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0762caa-9ac9-40f8-aa43-59a2f129476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f383de-2b62-43d1-8eeb-820937ac18da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f383de-2b62-43d1-8eeb-820937ac18da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6cbbfb29-226b-43e2-808d-1c948d024726', 'volume_name': 'volume-6cbbfb29-226b-43e2-808d-1c948d024726', 'volume_size': 1, 'image_id': 'aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0342ec5da62a214a9ae4126389b845d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8fd6263f62c6439ea741e02d866209ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1948e8c07c5cc1c88d918938748b2cde2694f6e846ae78350771e1ac6b09ce0f370e127d489f95623a6d1e646fa408b12e54140759fdf46d002fa30401d1dde3', 'id': 'aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'created_at': datetime.datetime(2026, 11, 5, 21, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 35, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa1f69ec-20a5-4c7a-8c9f-940709463cca/file', 'properties': {}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df047e1b-15bc-4ec2-b964-e05c3ad6e396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df047e1b-15bc-4ec2-b964-e05c3ad6e396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b102a54-a931-4047-a500-a86b4ac78bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Volume 6cbbfb29-226b-43e2-808d-1c948d024726: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6cbbfb29-226b-43e2-808d-1c948d024726', 'volume_size': 1, 'image_id': 'aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0342ec5da62a214a9ae4126389b845d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8fd6263f62c6439ea741e02d866209ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1948e8c07c5cc1c88d918938748b2cde2694f6e846ae78350771e1ac6b09ce0f370e127d489f95623a6d1e646fa408b12e54140759fdf46d002fa30401d1dde3', 'id': 'aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'created_at': datetime.datetime(2026, 11, 5, 21, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 35, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa1f69ec-20a5-4c7a-8c9f-940709463cca/file', 'properties': {}}, 'image_service': } Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Trying to clone 6cbbfb29-226b-43e2-808d-1c948d024726 from image aa1f69ec-20a5-4c7a-8c9f-940709463cca at location (None, [{'url': 'file:///opt/stack/data/glance/images/aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:35:02 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Image download 0.00 MB at 0.00 MB/s Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e197f8-d88b-4433-bdfe-104743155e94]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:02 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD Nov 05 22:35:02 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:03 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:03 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD Nov 05 22:35:03 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:03 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD" returned: 1 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:03 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Temporary image aa1f69ec-20a5-4c7a-8c9f-940709463cca is fetched for user 31af989af74e4693b93ac6a4b1e7e602. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:35:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdccd168-e85b-4075-96b3-9e1d5278de15]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:03 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD Nov 05 22:35:03 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:03 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:03 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD Nov 05 22:35:03 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:04 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cbbfb29-226b-43e2-808d-1c948d024726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd6263f62c6439ea741e02d866209ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:02Z,use_quota=True,user_id='31af989af74e4693b93ac6a4b1e7e602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Creating volume 6cbbfb29-226b-43e2-808d-1c948d024726 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:04 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:04 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 1073741824 Nov 05 22:35:04 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:04 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 1073741824" returned: 0 in 0.398s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:04 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 Nov 05 22:35:04 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:04 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726" returned: 0 in 0.236s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Attempting download of aa1f69ec-20a5-4c7a-8c9f-940709463cca ((None, [{'url': 'file:///opt/stack/data/glance/images/aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'metadata': {}}])) to volume 6cbbfb29-226b-43e2-808d-1c948d024726. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[93300411-f8d2-448c-8831-c48d4296b387]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa1f69ec-20a5-4c7a-8c9f-940709463cca_ebh1k82k {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:04 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa1f69ec-20a5-4c7a-8c9f-940709463cca_ebh1k82k Nov 05 22:35:04 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:05 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa1f69ec-20a5-4c7a-8c9f-940709463cca_ebh1k82k" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa1f69ec-20a5-4c7a-8c9f-940709463cca_ebh1k82k {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:05 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa1f69ec-20a5-4c7a-8c9f-940709463cca_ebh1k82k Nov 05 22:35:05 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:05 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa1f69ec-20a5-4c7a-8c9f-940709463cca_ebh1k82k" returned: 1 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa1f69ec-20a5-4c7a-8c9f-940709463cca_ebh1k82k' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256018e-257e-4bdd-9d28-687279dc8fa5]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:05 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD Nov 05 22:35:05 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:05 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD" returned: 0 in 0.311s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:05 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD Nov 05 22:35:05 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:06 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD" returned: 1 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] aa1f69ec-20a5-4c7a-8c9f-940709463cca was raw, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:06 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 Nov 05 22:35:06 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:06 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726" returned: 0 in 0.433s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa1f69ec-20a5-4c7a-8c9f-940709463cca_w8uj5m81devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:35:06 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:06 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 1G Nov 05 22:35:06 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:06 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 1G" returned: 0 in 0.305s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Downloaded image aa1f69ec-20a5-4c7a-8c9f-940709463cca ((None, [{'url': 'file:///opt/stack/data/glance/images/aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'metadata': {}}])) to volume 6cbbfb29-226b-43e2-808d-1c948d024726 successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Temporary image aa1f69ec-20a5-4c7a-8c9f-940709463cca for user 31af989af74e4693b93ac6a4b1e7e602 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Marking volume 6cbbfb29-226b-43e2-808d-1c948d024726 as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Copying metadata from image aa1f69ec-20a5-4c7a-8c9f-940709463cca to 6cbbfb29-226b-43e2-808d-1c948d024726. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Creating volume glance metadata for volume 6cbbfb29-226b-43e2-808d-1c948d024726 backed by image aa1f69ec-20a5-4c7a-8c9f-940709463cca with: {'image_id': 'aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0342ec5da62a214a9ae4126389b845d6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b102a54-a931-4047-a500-a86b4ac78bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cbbfb29-226b-43e2-808d-1c948d024726', 'volume_size': 1, 'image_id': 'aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0342ec5da62a214a9ae4126389b845d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8fd6263f62c6439ea741e02d866209ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1948e8c07c5cc1c88d918938748b2cde2694f6e846ae78350771e1ac6b09ce0f370e127d489f95623a6d1e646fa408b12e54140759fdf46d002fa30401d1dde3', 'id': 'aa1f69ec-20a5-4c7a-8c9f-940709463cca', 'created_at': datetime.datetime(2026, 11, 5, 21, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 35, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa1f69ec-20a5-4c7a-8c9f-940709463cca/file', 'properties': {}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767aab27-7524-4a3f-83bb-1235f9a6f27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Volume volume-6cbbfb29-226b-43e2-808d-1c948d024726 (6cbbfb29-226b-43e2-808d-1c948d024726): created successfully Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767aab27-7524-4a3f-83bb-1235f9a6f27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Flow 'volume_create_manager' (a300ca27-dc70-4549-9dce-ca43546d4375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0b258dd3-0b8e-4822-a5a6-d2a175b77427 tempest-VolumeImageDependencyTests-1569541253 None] Created volume successfully. Nov 05 22:35:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Acquiring lock "cinder-6cbbfb29-226b-43e2-808d-1c948d024726-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Lock "cinder-6cbbfb29-226b-43e2-808d-1c948d024726-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Acquiring lock "cinder-quobyte-6cbbfb29-226b-43e2-808d-1c948d024726" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Lock "cinder-quobyte-6cbbfb29-226b-43e2-808d-1c948d024726" acquired by "delete_volume" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2659fd87-ea64-4899-966a-45db8a0e746d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:07 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 Nov 05 22:35:07 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:08 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726" returned: 0 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:08 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726 Nov 05 22:35:08 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:08 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-6cbbfb29-226b-43e2-808d-1c948d024726" returned: 0 in 0.239s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Lock "cinder-quobyte-6cbbfb29-226b-43e2-808d-1c948d024726" released by "delete_volume" :: held 0.629s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Created reservations ['c52cacc2-8987-4076-839a-a15b4f9cd502', '5dd0130b-d84e-44a1-86ab-8ea9fcc90328', 'c7836a78-bd53-4ef0-8613-5e131b28660e', '3a85a570-5b1e-49a0-bd07-0cfeba76fba0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:08 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:08 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:08 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Deleted volume successfully. Nov 05 22:35:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-20380e31-3059-42d9-a340-3b4f1ead66d8 tempest-VolumeImageDependencyTests-1569541253 None] Lock "cinder-6cbbfb29-226b-43e2-808d-1c948d024726-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:18 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=79,cinder:UPDATE=118,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:35:18 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=98,cinder:UPDATE=112,cinder:DELETE=12,cinder:INSERT=33 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Flow 'volume_create_manager' (75d386f9-86ee-48e3-98bb-e152d0a8794e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8563f9c2-df3d-4eb2-9dec-9b2e85b3ac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8563f9c2-df3d-4eb2-9dec-9b2e85b3ac93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-424966295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261a9dd6-ac39-4a0c-9315-202bd68ee86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd290bb323e494a9342beaf93015c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:33Z,use_quota=True,user_id='9437ccbafd4c4d06b54546b801669644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1b8043-a3f3-4f50-8a1d-10759ccf3ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1b8043-a3f3-4f50-8a1d-10759ccf3ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f915eea7-f6a4-4062-9c1f-0fba3d34e5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f915eea7-f6a4-4062-9c1f-0fba3d34e5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261a9dd6-ac39-4a0c-9315-202bd68ee86c', 'volume_name': 'volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ed1ba7-96d9-4619-915c-6d4ffcf55cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ed1ba7-96d9-4619-915c-6d4ffcf55cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dd33f3-2882-40a1-9fe8-d4d86081b83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Volume 261a9dd6-ac39-4a0c-9315-202bd68ee86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c', 'volume_size': 1} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-424966295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261a9dd6-ac39-4a0c-9315-202bd68ee86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd290bb323e494a9342beaf93015c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:33Z,use_quota=True,user_id='9437ccbafd4c4d06b54546b801669644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Creating volume 261a9dd6-ac39-4a0c-9315-202bd68ee86c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:33 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:33 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c 1073741824 Nov 05 22:35:33 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (909f704d-017b-4877-bb4d-8ce8b65f50dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec891057-2b5c-4aff-bf7a-1fe43097b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Flow 'volume_create_manager' (cf9791d3-ce20-4095-8487-f7871217374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2196c025-0a95-4c5f-8bfd-395c7bb921fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec891057-2b5c-4aff-bf7a-1fe43097b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048818329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535fd1dc-b3d1-4fe7-b055-52d88ce48f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:33Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a0f5a4-8b6a-42c2-9221-5084ecdc730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a0f5a4-8b6a-42c2-9221-5084ecdc730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a8947a-7642-4d53-a0a5-277ad884705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a8947a-7642-4d53-a0a5-277ad884705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535fd1dc-b3d1-4fe7-b055-52d88ce48f97', 'volume_name': 'volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb87422-9ee3-4e03-be31-39ef2af51f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb87422-9ee3-4e03-be31-39ef2af51f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd198810-b159-4c0f-b1f4-b078f6d64c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume 535fd1dc-b3d1-4fe7-b055-52d88ce48f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97', 'volume_size': 1} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2196c025-0a95-4c5f-8bfd-395c7bb921fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780437643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303ca216-dfec-408e-a04a-a91ed857c6ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd290bb323e494a9342beaf93015c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:33Z,use_quota=True,user_id='9437ccbafd4c4d06b54546b801669644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d7a7d4-8767-4687-a277-eeb1771a07e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d7a7d4-8767-4687-a277-eeb1771a07e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d666f3-749c-4aeb-9503-9adfe599bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d666f3-749c-4aeb-9503-9adfe599bce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303ca216-dfec-408e-a04a-a91ed857c6ec', 'volume_name': 'volume-303ca216-dfec-408e-a04a-a91ed857c6ec', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59180b33-9152-43fc-ad52-3ff08facc841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59180b33-9152-43fc-ad52-3ff08facc841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153986c0-1501-4312-92a7-26a913d65aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Volume 303ca216-dfec-408e-a04a-a91ed857c6ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303ca216-dfec-408e-a04a-a91ed857c6ec', 'volume_size': 1} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Flow 'volume_create_manager' (4c149adf-6996-4067-bc34-6e19e788c067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:33 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ed1f40-ddb3-4143-aa1b-e6fc78b3d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c 1073741824" returned: 0 in 0.797s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ed1f40-ddb3-4143-aa1b-e6fc78b3d396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1008468717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2144f11-08e7-49dd-b158-5ca76329544c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd290bb323e494a9342beaf93015c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:34Z,use_quota=True,user_id='9437ccbafd4c4d06b54546b801669644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fece636-b329-45cb-a61b-031b950682f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fece636-b329-45cb-a61b-031b950682f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28ff976-e95c-4293-9192-4b6d94035685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28ff976-e95c-4293-9192-4b6d94035685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2144f11-08e7-49dd-b158-5ca76329544c', 'volume_name': 'volume-e2144f11-08e7-49dd-b158-5ca76329544c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43678b0b-13ea-423e-94e0-26727e2fba1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43678b0b-13ea-423e-94e0-26727e2fba1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a612aafc-8a1c-409e-9792-e0cb26f262d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Volume e2144f11-08e7-49dd-b158-5ca76329544c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2144f11-08e7-49dd-b158-5ca76329544c', 'volume_size': 1} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:34 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c Nov 05 22:35:34 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Flow 'volume_create_manager' (09982983-244d-4f0b-ab9b-8c7b6424aca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3d2531-7660-40e9-b173-392cf74215a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3d2531-7660-40e9-b173-392cf74215a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1260613465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb699d7-03f8-4737-8254-bb4f42275a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd290bb323e494a9342beaf93015c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:34Z,use_quota=True,user_id='9437ccbafd4c4d06b54546b801669644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:34 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c536e890-73e6-4f05-b493-a296ea9c7863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c536e890-73e6-4f05-b493-a296ea9c7863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37a3885-7691-4659-9e08-5fb6f93615d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37a3885-7691-4659-9e08-5fb6f93615d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb699d7-03f8-4737-8254-bb4f42275a87', 'volume_name': 'volume-5bb699d7-03f8-4737-8254-bb4f42275a87', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980c2b0d-933d-4b31-badf-8011931ce5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980c2b0d-933d-4b31-badf-8011931ce5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92d736f-1489-4d8b-84ab-c02ac88e3fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Volume 5bb699d7-03f8-4737-8254-bb4f42275a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb699d7-03f8-4737-8254-bb4f42275a87', 'volume_size': 1} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c" returned: 0 in 0.395s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.023s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048818329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535fd1dc-b3d1-4fe7-b055-52d88ce48f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:33Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Creating volume 535fd1dc-b3d1-4fe7-b055-52d88ce48f97 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:34 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dd33f3-2882-40a1-9fe8-d4d86081b83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921a0cc3-6ebe-4d22-99a4-80ba90c081bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:34 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 1073741824 Nov 05 22:35:34 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:34 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Volume volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c (261a9dd6-ac39-4a0c-9315-202bd68ee86c): created successfully Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921a0cc3-6ebe-4d22-99a4-80ba90c081bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:34 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Flow 'volume_create_manager' (75d386f9-86ee-48e3-98bb-e152d0a8794e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8e80de03-2215-4b56-8322-1a08521db979 tempest-CreateVolumesFromImageTest-258166158 None] Created volume successfully. Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Flow 'volume_create_manager' (af92a3af-e90c-423d-8ed7-976f412b9810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e46aff-8cd9-4c89-b046-92c9d43a802d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e46aff-8cd9-4c89-b046-92c9d43a802d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1470804101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2622ad53-b906-4327-b085-97fe7ee833d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd290bb323e494a9342beaf93015c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:35Z,use_quota=True,user_id='9437ccbafd4c4d06b54546b801669644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb690c5-654c-40e5-aebe-f88399a71e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb690c5-654c-40e5-aebe-f88399a71e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c3c18c-f89b-4d14-a088-5592cc89fe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c3c18c-f89b-4d14-a088-5592cc89fe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2622ad53-b906-4327-b085-97fe7ee833d0', 'volume_name': 'volume-2622ad53-b906-4327-b085-97fe7ee833d0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6c8022-050a-4de3-b984-55bead682aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e6c8022-050a-4de3-b984-55bead682aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0c754d-8822-4141-b1cb-8da187326f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Volume 2622ad53-b906-4327-b085-97fe7ee833d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2622ad53-b906-4327-b085-97fe7ee833d0', 'volume_size': 1} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:35 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 1073741824" returned: 0 in 0.668s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:35 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 Nov 05 22:35:35 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:35 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1780437643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303ca216-dfec-408e-a04a-a91ed857c6ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd290bb323e494a9342beaf93015c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:33Z,use_quota=True,user_id='9437ccbafd4c4d06b54546b801669644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Creating volume 303ca216-dfec-408e-a04a-a91ed857c6ec {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:35 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd198810-b159-4c0f-b1f4-b078f6d64c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:35 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec 1073741824 Nov 05 22:35:35 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c88125-200a-4d01-9b3e-4cd5e800e014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 (535fd1dc-b3d1-4fe7-b055-52d88ce48f97): created successfully Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c88125-200a-4d01-9b3e-4cd5e800e014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:35 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (909f704d-017b-4877-bb4d-8ce8b65f50dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a5f2e18a-5366-4214-8701-9d0255ff1467 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created volume successfully. Nov 05 22:35:36 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec 1073741824" returned: 0 in 0.557s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:36 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec Nov 05 22:35:36 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:36 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec" returned: 0 in 0.327s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.392s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1008468717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2144f11-08e7-49dd-b158-5ca76329544c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd290bb323e494a9342beaf93015c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:34Z,use_quota=True,user_id='9437ccbafd4c4d06b54546b801669644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Creating volume e2144f11-08e7-49dd-b158-5ca76329544c {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:36 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153986c0-1501-4312-92a7-26a913d65aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303ca216-dfec-408e-a04a-a91ed857c6ec', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:36 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c 1073741824 Nov 05 22:35:36 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fbc50b-92b9-460e-82f6-0cc1a89f2de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:36 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Volume volume-303ca216-dfec-408e-a04a-a91ed857c6ec (303ca216-dfec-408e-a04a-a91ed857c6ec): created successfully Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fbc50b-92b9-460e-82f6-0cc1a89f2de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Flow 'volume_create_manager' (cf9791d3-ce20-4095-8487-f7871217374f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:36 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-55845e79-ca56-49c3-bd6d-3e04d32e9acd tempest-CreateVolumesFromImageTest-258166158 None] Created volume successfully. Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Flow 'volume_create_manager' (f24210d4-d2fa-4003-9258-dd228f9fcf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d7e041-a1ec-45c4-8e85-2659605c0ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d7e041-a1ec-45c4-8e85-2659605c0ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bd354a-0550-4b29-8b3d-6e37f102850e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1a66270afc4ef28fbe230896546bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:37Z,use_quota=True,user_id='b51ac1e8e24047be939800518a11a814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9892be92-a51a-4aa2-9101-666cb60e3137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9892be92-a51a-4aa2-9101-666cb60e3137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda9d93b-f485-48b9-84d7-80a9e20c24a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:36 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda9d93b-f485-48b9-84d7-80a9e20c24a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74bd354a-0550-4b29-8b3d-6e37f102850e', 'volume_name': 'volume-74bd354a-0550-4b29-8b3d-6e37f102850e', 'volume_size': 1, 'image_id': '2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '717fe2c175fea79cfa3349efb72ad060', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f1a66270afc4ef28fbe230896546bde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '32d52c528496634f143fc9fb4eab3b017303ffcced72001a0ded3b2e04f8006c78a8c20d871eb6b8418594a67b1e6098ab24f1cfca07f50c4aa2ae2d4cd2c998', 'id': '2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'created_at': datetime.datetime(2026, 11, 5, 21, 35, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 35, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b84413b-bb71-4a24-aaa2-4d7923eb4858/file', 'properties': {}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2ef9e6-a7c8-408e-8ef7-62de44d880de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2ef9e6-a7c8-408e-8ef7-62de44d880de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6d67b4-b021-415c-a019-1d8d0102b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Volume 74bd354a-0550-4b29-8b3d-6e37f102850e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74bd354a-0550-4b29-8b3d-6e37f102850e', 'volume_size': 1, 'image_id': '2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '717fe2c175fea79cfa3349efb72ad060', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f1a66270afc4ef28fbe230896546bde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '32d52c528496634f143fc9fb4eab3b017303ffcced72001a0ded3b2e04f8006c78a8c20d871eb6b8418594a67b1e6098ab24f1cfca07f50c4aa2ae2d4cd2c998', 'id': '2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'created_at': datetime.datetime(2026, 11, 5, 21, 35, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 35, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b84413b-bb71-4a24-aaa2-4d7923eb4858/file', 'properties': {}}, 'image_service': } Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Trying to clone 74bd354a-0550-4b29-8b3d-6e37f102850e from image 2b84413b-bb71-4a24-aaa2-4d7923eb4858 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:35:37 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c 1073741824" returned: 0 in 0.624s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:35:37 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Image download 0.00 MB at 0.00 MB/s Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:37 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c Nov 05 22:35:37 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b38692-ad1a-4437-a139-b53f975d743c]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:37 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD Nov 05 22:35:37 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Flow 'volume_create_manager' (a59aa066-303e-4cf3-883c-98db9ced3345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3514cc1d-320d-414d-b84c-ab101bde0763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3514cc1d-320d-414d-b84c-ab101bde0763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ffb46a-1cf0-4658-92e1-32012cd96a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ed0afcaa594421894e328cb6e94764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:37Z,use_quota=True,user_id='899628297abb4b01bca4f533c95df2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4471bad-12e8-4e6c-9263-67668c24ccf6),volume_type_id=b4471bad-12e8-4e6c-9263-67668c24ccf6)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3cb707-e22a-4d18-850c-dce76316d902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3cb707-e22a-4d18-850c-dce76316d902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353c7c51-0ceb-4b42-861d-00695f02b2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.image.glance [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Creating Keystone auth plugin from conf {{(pid=87122) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:35:37 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.939s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1260613465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb699d7-03f8-4737-8254-bb4f42275a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd290bb323e494a9342beaf93015c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:34Z,use_quota=True,user_id='9437ccbafd4c4d06b54546b801669644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Creating volume 5bb699d7-03f8-4737-8254-bb4f42275a87 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:37 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a612aafc-8a1c-409e-9792-e0cb26f262d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2144f11-08e7-49dd-b158-5ca76329544c', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:37 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87 1073741824 Nov 05 22:35:37 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fda2d64-f792-4e0b-8db0-6bcd521b1569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Volume volume-e2144f11-08e7-49dd-b158-5ca76329544c (e2144f11-08e7-49dd-b158-5ca76329544c): created successfully Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fda2d64-f792-4e0b-8db0-6bcd521b1569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Flow 'volume_create_manager' (4c149adf-6996-4067-bc34-6e19e788c067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-df6179e8-4edb-484a-91f2-09862b9ec225 tempest-CreateVolumesFromImageTest-258166158 None] Created volume successfully. Nov 05 22:35:37 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353c7c51-0ceb-4b42-861d-00695f02b2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3ffb46a-1cf0-4658-92e1-32012cd96a0f', 'volume_name': 'volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f', 'volume_size': 1, 'image_id': '57820789-73c3-4b15-b653-473c20eb5408', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57820789-73c3-4b15-b653-473c20eb5408', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '87d0f6693d64cff26ae24d86094db07d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96ed0afcaa594421894e328cb6e94764', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '286244757826a8f815dbaee4fd4ef0c3b31ce737d97f5f1a1dabbfb49ea3632196f78da9307c49bcdd6f517241f61b54f29e7257e2c62c68c4ce40bfed60bdd5', 'id': '57820789-73c3-4b15-b653-473c20eb5408', 'created_at': datetime.datetime(2026, 11, 5, 21, 35, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 35, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57820789-73c3-4b15-b653-473c20eb5408/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e665437e-273d-47be-986f-11e0b0704fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e665437e-273d-47be-986f-11e0b0704fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1997ed-ea74-4a36-8a6d-3cbec0a667dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Volume a3ffb46a-1cf0-4658-92e1-32012cd96a0f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f', 'volume_size': 1, 'image_id': '57820789-73c3-4b15-b653-473c20eb5408', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57820789-73c3-4b15-b653-473c20eb5408', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '87d0f6693d64cff26ae24d86094db07d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96ed0afcaa594421894e328cb6e94764', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '286244757826a8f815dbaee4fd4ef0c3b31ce737d97f5f1a1dabbfb49ea3632196f78da9307c49bcdd6f517241f61b54f29e7257e2c62c68c4ce40bfed60bdd5', 'id': '57820789-73c3-4b15-b653-473c20eb5408', 'created_at': datetime.datetime(2026, 11, 5, 21, 35, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 35, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57820789-73c3-4b15-b653-473c20eb5408/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Trying to clone a3ffb46a-1cf0-4658-92e1-32012cd96a0f from image 57820789-73c3-4b15-b653-473c20eb5408 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57820789-73c3-4b15-b653-473c20eb5408', 'metadata': {}}]). {{(pid=87122) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:35:37 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD Nov 05 22:35:37 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:35:37 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Image download 0.00 MB at 0.00 MB/s Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[07de97d0-b89d-4130-8a58-c9bf56df5575]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:38 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87 1073741824" returned: 0 in 0.508s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:38 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Temporary image 2b84413b-bb71-4a24-aaa2-4d7923eb4858 is fetched for user b51ac1e8e24047be939800518a11a814. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:35:38 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD Nov 05 22:35:38 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:38 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87 Nov 05 22:35:38 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c4aa19-c1d8-4ed9-8973-605e6330007e]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:38 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD Nov 05 22:35:38 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:38 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:38 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.232s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1470804101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2622ad53-b906-4327-b085-97fe7ee833d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd290bb323e494a9342beaf93015c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:35Z,use_quota=True,user_id='9437ccbafd4c4d06b54546b801669644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Creating volume 2622ad53-b906-4327-b085-97fe7ee833d0 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:38 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92d736f-1489-4d8b-84ab-c02ac88e3fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb699d7-03f8-4737-8254-bb4f42275a87', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3202f43-be1d-4372-8430-b037c5595270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:38 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0 1073741824 Nov 05 22:35:38 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Volume volume-5bb699d7-03f8-4737-8254-bb4f42275a87 (5bb699d7-03f8-4737-8254-bb4f42275a87): created successfully Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3202f43-be1d-4372-8430-b037c5595270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:38 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Flow 'volume_create_manager' (09982983-244d-4f0b-ab9b-8c7b6424aca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:38 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:38 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a17e4a10-028c-4015-802c-47d37f5f4b24 tempest-CreateVolumesFromImageTest-258166158 None] Created volume successfully. Nov 05 22:35:38 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:38 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD Nov 05 22:35:38 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:38 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD" returned: 1 in 0.409s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Temporary image 57820789-73c3-4b15-b653-473c20eb5408 is fetched for user 899628297abb4b01bca4f533c95df2f2. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dfbb6e-fea0-4005-bb1b-394c42b7e217]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:38 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0 1073741824" returned: 0 in 0.518s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:38 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:38 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD Nov 05 22:35:38 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:38 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0 Nov 05 22:35:38 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:39 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:39 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0" returned: 0 in 0.255s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.500s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0c754d-8822-4141-b1cb-8da187326f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2622ad53-b906-4327-b085-97fe7ee833d0', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a85a51-b029-4e9d-b898-c3385b718a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Creating offline snapshot 0317a7d6-b1e7-4872-b730-6f9eccd9055b of volume 535fd1dc-b3d1-4fe7-b055-52d88ce48f97 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:35:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Volume volume-2622ad53-b906-4327-b085-97fe7ee833d0 (2622ad53-b906-4327-b085-97fe7ee833d0): created successfully Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a85a51-b029-4e9d-b898-c3385b718a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Flow 'volume_create_manager' (af92a3af-e90c-423d-8ed7-976f412b9810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb806a29-335b-4f5b-aac8-a7969e2642b4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:39 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD Nov 05 22:35:39 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-78d9100d-a4d3-4be9-bd95-898ba9a0aac4 tempest-CreateVolumesFromImageTest-258166158 None] Created volume successfully. Nov 05 22:35:39 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 Nov 05 22:35:39 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:39 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "cinder-2622ad53-b906-4327-b085-97fe7ee833d0-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-2622ad53-b906-4327-b085-97fe7ee833d0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "cinder-quobyte-2622ad53-b906-4327-b085-97fe7ee833d0" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-quobyte-2622ad53-b906-4327-b085-97fe7ee833d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64f6670-7ebe-426b-a935-8dff0e6b80bd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:39 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" returned: 0 in 0.451s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:39 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b 1G Nov 05 22:35:39 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:39 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0 Nov 05 22:35:39 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:40 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:40 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0 Nov 05 22:35:40 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:40 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b 1G" returned: 0 in 0.439s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:40 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b Nov 05 22:35:40 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:40 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-2622ad53-b906-4327-b085-97fe7ee833d0" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-quobyte-2622ad53-b906-4327-b085-97fe7ee833d0" released by "delete_volume" :: held 0.692s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Created reservations ['18511dc2-ed51-4523-a44c-b04a503c8f3c', '954a57e2-0b8f-4000-a0a9-b72be7365bf3', 'f910a739-46d1-4385-a8ef-392f4c98943a', '156444e6-e616-4103-b0f1-f8ccf2aa1014'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:40 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:40 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:40 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b" returned: 0 in 0.324s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:40 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b is being set with open permissions: ugo+rw Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:40 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b Nov 05 22:35:40 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:40 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.295s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "cinder-5bb699d7-03f8-4737-8254-bb4f42275a87-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Deleted volume successfully. Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-577c81b0-c6bf-4e10-ade9-db962d315b18 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-2622ad53-b906-4327-b085-97fe7ee833d0-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-5bb699d7-03f8-4737-8254-bb4f42275a87-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:40 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "cinder-quobyte-5bb699d7-03f8-4737-8254-bb4f42275a87" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-quobyte-5bb699d7-03f8-4737-8254-bb4f42275a87" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7920f4-7dd3-4051-b014-e6655815ce43]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:40 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.info Nov 05 22:35:40 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:40 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87 Nov 05 22:35:40 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:41 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.info" returned: 0 in 0.264s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:41 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.info is being set with open permissions: ugo+rw Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:41 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.info Nov 05 22:35:41 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:41 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87" returned: 0 in 0.375s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:41 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87 Nov 05 22:35:41 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:41 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.info" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.479s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bd354a-0550-4b29-8b3d-6e37f102850e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1a66270afc4ef28fbe230896546bde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:37Z,use_quota=True,user_id='b51ac1e8e24047be939800518a11a814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Creating volume 74bd354a-0550-4b29-8b3d-6e37f102850e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:41 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:41 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e 1073741824 Nov 05 22:35:41 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9f39d31b-bd8e-4d33-a78a-2c6080ee833c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Create snapshot completed successfully Nov 05 22:35:41 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5bb699d7-03f8-4737-8254-bb4f42275a87" returned: 0 in 0.267s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-quobyte-5bb699d7-03f8-4737-8254-bb4f42275a87" released by "delete_volume" :: held 0.692s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Created reservations ['297c549b-04e1-488a-af54-b0b79ed8dc59', '123e5ed6-2f9e-4685-8754-bf1870f74649', '6d324886-c8ab-4019-bf7d-7779979b007f', 'b6d1b99b-403d-40ae-9bef-1c4e7765e42a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:41 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:41 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:41 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "cinder-e2144f11-08e7-49dd-b158-5ca76329544c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:41 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e 1073741824" returned: 0 in 0.556s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:41 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Deleted volume successfully. Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-e2144f11-08e7-49dd-b158-5ca76329544c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d6fb863-046b-4405-98ce-05e4c836edf5 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-5bb699d7-03f8-4737-8254-bb4f42275a87-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "cinder-quobyte-e2144f11-08e7-49dd-b158-5ca76329544c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:42 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e Nov 05 22:35:42 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-quobyte-e2144f11-08e7-49dd-b158-5ca76329544c" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[16371416-2061-4337-a714-e3e7bbae1f20]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:42 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c Nov 05 22:35:42 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (42632cbf-a698-425d-870e-a75530a26aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c255f7-16b9-4e36-bd66-0f92e974b638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c255f7-16b9-4e36-bd66-0f92e974b638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1181457588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69743e88-d62d-49b0-b9bf-05e06dca97c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:42Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c74997-bfa0-4273-9fc2-972d5699c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c74997-bfa0-4273-9fc2-972d5699c26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:42 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcf1dd4-86f2-4afa-b6f6-18e75e8d2ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcf1dd4-86f2-4afa-b6f6-18e75e8d2ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69743e88-d62d-49b0-b9bf-05e06dca97c9', 'volume_name': 'volume-69743e88-d62d-49b0-b9bf-05e06dca97c9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee3c96c-f5b9-4b41-947c-1a970e8aa640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee3c96c-f5b9-4b41-947c-1a970e8aa640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bf7874-6810-4b91-abf3-44a2a961407b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume 69743e88-d62d-49b0-b9bf-05e06dca97c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69743e88-d62d-49b0-b9bf-05e06dca97c9', 'volume_size': 1} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e" returned: 0 in 0.346s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.877s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ffb46a-1cf0-4658-92e1-32012cd96a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ed0afcaa594421894e328cb6e94764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:37Z,use_quota=True,user_id='899628297abb4b01bca4f533c95df2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4471bad-12e8-4e6c-9263-67668c24ccf6),volume_type_id=b4471bad-12e8-4e6c-9263-67668c24ccf6)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Creating volume a3ffb46a-1cf0-4658-92e1-32012cd96a0f {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:42 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Attempting download of 2b84413b-bb71-4a24-aaa2-4d7923eb4858 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'metadata': {}}])) to volume 74bd354a-0550-4b29-8b3d-6e37f102850e. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:35:42 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f 1073741824 Nov 05 22:35:42 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[010a4b0b-2e92-4ba8-838e-0b2476529b76]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b84413b-bb71-4a24-aaa2-4d7923eb4858_ii0p8x53 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:42 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c" returned: 0 in 0.479s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:42 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b84413b-bb71-4a24-aaa2-4d7923eb4858_ii0p8x53 Nov 05 22:35:42 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:42 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c Nov 05 22:35:42 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (f91d80c9-9940-40d4-85a3-1a8a8bae99d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09d7187-a566-4cbc-b93f-9b812a339003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09d7187-a566-4cbc-b93f-9b812a339003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1840811295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:43Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6316102-5583-417e-9595-da10ef97d0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6316102-5583-417e-9595-da10ef97d0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573bb1e8-a649-426a-9eda-7646a92bcfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573bb1e8-a649-426a-9eda-7646a92bcfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d', 'volume_name': 'volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cdd25b-6989-44fa-b6fb-09d4b156cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cdd25b-6989-44fa-b6fb-09d4b156cac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5f935f-59fb-4297-bea4-3a386a96e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume 8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d', 'volume_size': 1} Nov 05 22:35:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:43 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b84413b-bb71-4a24-aaa2-4d7923eb4858_ii0p8x53" returned: 0 in 0.480s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b84413b-bb71-4a24-aaa2-4d7923eb4858_ii0p8x53 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:43 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e2144f11-08e7-49dd-b158-5ca76329544c" returned: 0 in 0.398s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-quobyte-e2144f11-08e7-49dd-b158-5ca76329544c" released by "delete_volume" :: held 0.948s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Created reservations ['d0f6ab3b-456e-46f3-9b50-a3042dab41d5', '2240311b-6e5f-4e35-90a4-9654960e6db9', '65c2b552-a3cd-4879-be83-1e4a215950ad', 'c864dddd-fd8e-43d6-80da-39208fe018a2'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:43 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b84413b-bb71-4a24-aaa2-4d7923eb4858_ii0p8x53 Nov 05 22:35:43 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:43 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f 1073741824" returned: 0 in 0.792s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (b1194f02-ce15-4c6b-91a8-6027e19aae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b810e8c0-889f-4536-98fd-dc808a79dc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b810e8c0-889f-4536-98fd-dc808a79dc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2023491396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6e805b-2d84-4577-9815-81e1576b94a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:43Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43371854-748a-477f-bf56-40a32b8601ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:43 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f Nov 05 22:35:43 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43371854-748a-477f-bf56-40a32b8601ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c52543c-2dda-461f-8408-f5e7392375df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c52543c-2dda-461f-8408-f5e7392375df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c6e805b-2d84-4577-9815-81e1576b94a4', 'volume_name': 'volume-1c6e805b-2d84-4577-9815-81e1576b94a4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44905952-9cb5-4d3f-ab24-6a7bf9466145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44905952-9cb5-4d3f-ab24-6a7bf9466145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69450f9-e3fe-4e26-9653-8dff9ec8e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:43 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume 1c6e805b-2d84-4577-9815-81e1576b94a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c6e805b-2d84-4577-9815-81e1576b94a4', 'volume_size': 1} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:43 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:43 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:43 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b84413b-bb71-4a24-aaa2-4d7923eb4858_ii0p8x53" returned: 1 in 0.439s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b84413b-bb71-4a24-aaa2-4d7923eb4858_ii0p8x53' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f2bf1c-ed4c-49d1-8896-a22fd8ac0c07]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:43 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD Nov 05 22:35:43 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:43 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f" returned: 0 in 0.313s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.237s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1181457588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69743e88-d62d-49b0-b9bf-05e06dca97c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:42Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Creating volume 69743e88-d62d-49b0-b9bf-05e06dca97c9 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:43 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:43 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9 1073741824 Nov 05 22:35:43 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Attempting download of 57820789-73c3-4b15-b653-473c20eb5408 ((None, [{'url': 'file:///opt/stack/data/glance/images/57820789-73c3-4b15-b653-473c20eb5408', 'metadata': {}}])) to volume a3ffb46a-1cf0-4658-92e1-32012cd96a0f. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:35:43 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda82d5f-657d-41a0-b7aa-75ba80e2bbb7]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57820789-73c3-4b15-b653-473c20eb5408_b8dndg2b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.476s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:43 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:43 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Deleted volume successfully. Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6d0e0f46-8da1-4afe-8bec-cf76607fe84f tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-e2144f11-08e7-49dd-b158-5ca76329544c-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:43 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:43 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57820789-73c3-4b15-b653-473c20eb5408_b8dndg2b Nov 05 22:35:44 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:44 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD Nov 05 22:35:44 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (c6d9273e-72b6-4b50-a40b-4e1dd529a968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6e579d-7e28-4b19-afea-78b7bf6014e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6e579d-7e28-4b19-afea-78b7bf6014e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-688784561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469c467e-0440-4d19-a097-65ab6f75c038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:44Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75929283-fc4d-4803-b3af-c3bfdbfe57a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75929283-fc4d-4803-b3af-c3bfdbfe57a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b609682f-ce46-4d42-abbf-3b115469f1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b609682f-ce46-4d42-abbf-3b115469f1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469c467e-0440-4d19-a097-65ab6f75c038', 'volume_name': 'volume-469c467e-0440-4d19-a097-65ab6f75c038', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84244260-93aa-48b9-bdbc-180c7a7c3f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84244260-93aa-48b9-bdbc-180c7a7c3f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc596616-0ffb-4e68-8f8c-bc0f785f6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume 469c467e-0440-4d19-a097-65ab6f75c038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469c467e-0440-4d19-a097-65ab6f75c038', 'volume_size': 1} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "cinder-303ca216-dfec-408e-a04a-a91ed857c6ec-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-303ca216-dfec-408e-a04a-a91ed857c6ec-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:44 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57820789-73c3-4b15-b653-473c20eb5408_b8dndg2b" returned: 0 in 0.509s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57820789-73c3-4b15-b653-473c20eb5408_b8dndg2b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:44 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD" returned: 1 in 0.528s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] 2b84413b-bb71-4a24-aaa2-4d7923eb4858 was raw, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:44 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e Nov 05 22:35:44 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "cinder-quobyte-303ca216-dfec-408e-a04a-a91ed857c6ec" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:44 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57820789-73c3-4b15-b653-473c20eb5408_b8dndg2b Nov 05 22:35:44 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-quobyte-303ca216-dfec-408e-a04a-a91ed857c6ec" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:44 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9 1073741824" returned: 0 in 0.905s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cce395-66c8-44e7-a56e-5042d25be488]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (eebed973-6553-4d74-87a1-ad9e32bde833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:44 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9 Nov 05 22:35:44 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a08442-fd74-4deb-9b98-dec404297056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a08442-fd74-4deb-9b98-dec404297056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1594224202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febbbc5f-4351-4dc2-8ba4-d1cd8385e398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:45Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6db690-5a33-4303-9a02-77858e2a5237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6db690-5a33-4303-9a02-77858e2a5237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b1c687-6fb2-4a0b-a2e4-908c61a80e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b1c687-6fb2-4a0b-a2e4-908c61a80e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'febbbc5f-4351-4dc2-8ba4-d1cd8385e398', 'volume_name': 'volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5787a2ee-a5e8-4716-895d-deb5989e9012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5787a2ee-a5e8-4716-895d-deb5989e9012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a41419e-d9b8-496e-8d2c-db74010fe364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume febbbc5f-4351-4dc2-8ba4-d1cd8385e398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398', 'volume_size': 1} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:44 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec Nov 05 22:35:44 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:44 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57820789-73c3-4b15-b653-473c20eb5408_b8dndg2b" returned: 1 in 0.565s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57820789-73c3-4b15-b653-473c20eb5408_b8dndg2b' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b475d9-0c7a-4039-9c06-8755d887d1a8]: (4, 'raw') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:44 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.089s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1840811295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:43Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Creating volume 8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:45 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:45 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e" returned: 0 in 0.634s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2b84413b-bb71-4a24-aaa2-4d7923eb4858_e59le8kwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:35:45 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:45 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d 1073741824 Nov 05 22:35:45 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:45 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD Nov 05 22:35:45 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bf7874-6810-4b91-abf3-44a2a961407b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69743e88-d62d-49b0-b9bf-05e06dca97c9', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:45 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e 1G Nov 05 22:35:45 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de54a78f-abdc-4630-9563-122d689352fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:45 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec" returned: 0 in 0.563s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:45 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume volume-69743e88-d62d-49b0-b9bf-05e06dca97c9 (69743e88-d62d-49b0-b9bf-05e06dca97c9): created successfully Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de54a78f-abdc-4630-9563-122d689352fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:45 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec Nov 05 22:35:45 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (42632cbf-a698-425d-870e-a75530a26aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-012372f1-3f6a-4824-af22-03cf6a9abfc9 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created volume successfully. Nov 05 22:35:45 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:45 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-303ca216-dfec-408e-a04a-a91ed857c6ec" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-quobyte-303ca216-dfec-408e-a04a-a91ed857c6ec" released by "delete_volume" :: held 0.946s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:45 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e 1G" returned: 0 in 0.411s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Downloaded image 2b84413b-bb71-4a24-aaa2-4d7923eb4858 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'metadata': {}}])) to volume 74bd354a-0550-4b29-8b3d-6e37f102850e successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Temporary image 2b84413b-bb71-4a24-aaa2-4d7923eb4858 for user b51ac1e8e24047be939800518a11a814 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Marking volume 74bd354a-0550-4b29-8b3d-6e37f102850e as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Copying metadata from image 2b84413b-bb71-4a24-aaa2-4d7923eb4858 to 74bd354a-0550-4b29-8b3d-6e37f102850e. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:35:45 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD Nov 05 22:35:45 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Creating volume glance metadata for volume 74bd354a-0550-4b29-8b3d-6e37f102850e backed by image 2b84413b-bb71-4a24-aaa2-4d7923eb4858 with: {'image_id': '2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '717fe2c175fea79cfa3349efb72ad060', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Created reservations ['43899089-34ce-4751-9ccc-7ddce6a71901', '7b9dcbd9-9253-48b5-82eb-e38dd624f7ac', '3ce5a520-cf87-4ae3-a07d-f4ebbe7e9cb9', '003de668-89ac-4eb5-83d4-652e34e2358c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6d67b4-b021-415c-a019-1d8d0102b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74bd354a-0550-4b29-8b3d-6e37f102850e', 'volume_size': 1, 'image_id': '2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '717fe2c175fea79cfa3349efb72ad060', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f1a66270afc4ef28fbe230896546bde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '32d52c528496634f143fc9fb4eab3b017303ffcced72001a0ded3b2e04f8006c78a8c20d871eb6b8418594a67b1e6098ab24f1cfca07f50c4aa2ae2d4cd2c998', 'id': '2b84413b-bb71-4a24-aaa2-4d7923eb4858', 'created_at': datetime.datetime(2026, 11, 5, 21, 35, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 35, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b84413b-bb71-4a24-aaa2-4d7923eb4858/file', 'properties': {}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a04fedd-c591-4361-b624-7ce56939529d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:45 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Volume volume-74bd354a-0550-4b29-8b3d-6e37f102850e (74bd354a-0550-4b29-8b3d-6e37f102850e): created successfully Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a04fedd-c591-4361-b624-7ce56939529d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Flow 'volume_create_manager' (f24210d4-d2fa-4003-9258-dd228f9fcf05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2c6ee723-a3d9-4a8a-92e4-5d0b83257000 tempest-VolumeImageDependencyTests-857586203 None] Created volume successfully. Nov 05 22:35:45 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d 1073741824" returned: 0 in 0.665s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:45 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:45 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:45 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] 57820789-73c3-4b15-b653-473c20eb5408 was raw, converting to qcow2 {{(pid=87122) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:35:45 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d Nov 05 22:35:45 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:45 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f Nov 05 22:35:45 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:45 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:45 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Deleted volume successfully. Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-98f22e50-1f48-46dc-bd05-a9c5dc758d1b tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-303ca216-dfec-408e-a04a-a91ed857c6ec-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:46 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.690s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2023491396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6e805b-2d84-4577-9815-81e1576b94a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:43Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Creating volume 1c6e805b-2d84-4577-9815-81e1576b94a4 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:46 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5f935f-59fb-4297-bea4-3a386a96e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a171de9c-1e5e-440f-a9df-1e4579555446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:46 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4 1073741824 Nov 05 22:35:46 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d (8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d): created successfully Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a171de9c-1e5e-440f-a9df-1e4579555446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (f91d80c9-9940-40d4-85a3-1a8a8bae99d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-17d6d061-ec1b-42b0-bc50-a289408e1201 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created volume successfully. Nov 05 22:35:46 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f" returned: 0 in 0.493s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57820789-73c3-4b15-b653-473c20eb5408_qgrjzkv1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:35:46 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:46 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f 1G Nov 05 22:35:46 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Acquiring lock "cinder-74bd354a-0550-4b29-8b3d-6e37f102850e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Lock "cinder-74bd354a-0550-4b29-8b3d-6e37f102850e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Acquiring lock "cinder-quobyte-74bd354a-0550-4b29-8b3d-6e37f102850e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Lock "cinder-quobyte-74bd354a-0550-4b29-8b3d-6e37f102850e" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc3f6c2-f465-4de5-a4a9-1a7314c6a99e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:46 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e Nov 05 22:35:46 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:46 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4 1073741824" returned: 0 in 0.581s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:46 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f 1G" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Downloaded image 57820789-73c3-4b15-b653-473c20eb5408 ((None, [{'url': 'file:///opt/stack/data/glance/images/57820789-73c3-4b15-b653-473c20eb5408', 'metadata': {}}])) to volume a3ffb46a-1cf0-4658-92e1-32012cd96a0f successfully. {{(pid=87122) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Temporary image 57820789-73c3-4b15-b653-473c20eb5408 for user 899628297abb4b01bca4f533c95df2f2 is deleted. {{(pid=87122) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.volume_utils [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Marking volume a3ffb46a-1cf0-4658-92e1-32012cd96a0f as bootable. {{(pid=87122) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Copying metadata from image 57820789-73c3-4b15-b653-473c20eb5408 to a3ffb46a-1cf0-4658-92e1-32012cd96a0f. {{(pid=87122) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Creating volume glance metadata for volume a3ffb46a-1cf0-4658-92e1-32012cd96a0f backed by image 57820789-73c3-4b15-b653-473c20eb5408 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '57820789-73c3-4b15-b653-473c20eb5408', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '87d0f6693d64cff26ae24d86094db07d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87122) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:46 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4 Nov 05 22:35:46 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1997ed-ea74-4a36-8a6d-3cbec0a667dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f', 'volume_size': 1, 'image_id': '57820789-73c3-4b15-b653-473c20eb5408', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57820789-73c3-4b15-b653-473c20eb5408', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '87d0f6693d64cff26ae24d86094db07d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96ed0afcaa594421894e328cb6e94764', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '286244757826a8f815dbaee4fd4ef0c3b31ce737d97f5f1a1dabbfb49ea3632196f78da9307c49bcdd6f517241f61b54f29e7257e2c62c68c4ce40bfed60bdd5', 'id': '57820789-73c3-4b15-b653-473c20eb5408', 'created_at': datetime.datetime(2026, 11, 5, 21, 35, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 35, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57820789-73c3-4b15-b653-473c20eb5408/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c524345-92ad-4677-a761-0741e476fd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:46 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Volume volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f (a3ffb46a-1cf0-4658-92e1-32012cd96a0f): created successfully Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c524345-92ad-4677-a761-0741e476fd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Flow 'volume_create_manager' (a59aa066-303e-4cf3-883c-98db9ced3345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b3ca3d8f-6cda-42ef-90b0-1c1efd26393f tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Created volume successfully. Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "cinder-261a9dd6-ac39-4a0c-9315-202bd68ee86c-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-261a9dd6-ac39-4a0c-9315-202bd68ee86c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "cinder-quobyte-261a9dd6-ac39-4a0c-9315-202bd68ee86c" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:46 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e" returned: 0 in 0.471s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-quobyte-261a9dd6-ac39-4a0c-9315-202bd68ee86c" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:47 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e Nov 05 22:35:47 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b4610-82f8-46db-9b11-0d86988b55ea]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:47 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4" returned: 0 in 0.335s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.880s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-688784561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=469c467e-0440-4d19-a097-65ab6f75c038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:44Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Creating volume 469c467e-0440-4d19-a097-65ab6f75c038 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:47 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69450f9-e3fe-4e26-9653-8dff9ec8e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c6e805b-2d84-4577-9815-81e1576b94a4', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5587bce2-cf11-47e8-a429-3a3644481220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:47 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume volume-1c6e805b-2d84-4577-9815-81e1576b94a4 (1c6e805b-2d84-4577-9815-81e1576b94a4): created successfully Nov 05 22:35:47 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038 1073741824 Nov 05 22:35:47 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5587bce2-cf11-47e8-a429-3a3644481220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (b1194f02-ce15-4c6b-91a8-6027e19aae09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6c569b9f-215d-4fc3-8d3e-7e85f0c8d8b8 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created volume successfully. Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Acquiring lock "cinder-a3ffb46a-1cf0-4658-92e1-32012cd96a0f-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:47 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c Nov 05 22:35:47 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Lock "cinder-a3ffb46a-1cf0-4658-92e1-32012cd96a0f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:47 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Acquiring lock "cinder-quobyte-a3ffb46a-1cf0-4658-92e1-32012cd96a0f" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-74bd354a-0550-4b29-8b3d-6e37f102850e" returned: 0 in 0.319s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Lock "cinder-quobyte-74bd354a-0550-4b29-8b3d-6e37f102850e" released by "delete_volume" :: held 0.844s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Lock "cinder-quobyte-a3ffb46a-1cf0-4658-92e1-32012cd96a0f" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfd6970-e97d-484c-a76e-e999fed46a20]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Created reservations ['44803ad7-9418-42b5-b2ea-81241b96a7da', '7dbd3628-9859-4864-a95f-b821a33d50e9', 'a5bf3c97-e77c-4ca8-9303-403cabe04998', '1ffa2b68-3e2a-4304-a5a6-25df93d0c070'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:47 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:47 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:47 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:47 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:47 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c" returned: 0 in 0.509s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:47 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c Nov 05 22:35:47 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:47 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038 1073741824" returned: 0 in 0.681s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:47 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:47 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038 Nov 05 22:35:47 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:47 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Deleted volume successfully. Nov 05 22:35:47 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-261a9dd6-ac39-4a0c-9315-202bd68ee86c" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-quobyte-261a9dd6-ac39-4a0c-9315-202bd68ee86c" released by "delete_volume" :: held 0.940s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7fb7e2b9-66e8-4097-9c32-d9d95779cd54 tempest-VolumeImageDependencyTests-857586203 None] Lock "cinder-74bd354a-0550-4b29-8b3d-6e37f102850e-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:47 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f" returned: 0 in 0.624s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:48 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f Nov 05 22:35:48 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Created reservations ['25b5a853-659e-4662-8c22-67522b789cb7', '50db7805-45b0-4697-b182-c044964d2a67', '8cc3344f-8963-4d67-b0f5-ad0541df23dc', '27453944-9420-4c6f-8f9e-59dad3e484e8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:48 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038" returned: 0 in 0.323s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.363s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1594224202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febbbc5f-4351-4dc2-8ba4-d1cd8385e398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6add3790e1d34f3780c489ba314c2356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:45Z,use_quota=True,user_id='f0234e2550644d9dbddf84faf7ba1bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Creating volume febbbc5f-4351-4dc2-8ba4-d1cd8385e398 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:48 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:48 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398 1073741824 Nov 05 22:35:48 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc596616-0ffb-4e68-8f8c-bc0f785f6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469c467e-0440-4d19-a097-65ab6f75c038', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89881f3b-8f4a-44ae-9730-a8e71bf45359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:48 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:48 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:48 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume volume-469c467e-0440-4d19-a097-65ab6f75c038 (469c467e-0440-4d19-a097-65ab6f75c038): created successfully Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89881f3b-8f4a-44ae-9730-a8e71bf45359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (c6d9273e-72b6-4b50-a40b-4e1dd529a968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a1a5c572-b5f6-4453-a7c6-4b279486f86e tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created volume successfully. Nov 05 22:35:48 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a3ffb46a-1cf0-4658-92e1-32012cd96a0f" returned: 0 in 0.397s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Lock "cinder-quobyte-a3ffb46a-1cf0-4658-92e1-32012cd96a0f" released by "delete_volume" :: held 1.078s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Created reservations ['4530fdd4-0dec-43f8-83da-7c71c9e68d89', '45f76e15-335f-4ed8-9377-52d342aed90c', 'efcca86e-2efe-4e65-aba2-bcee7097a0c6', '4c2b8bad-b523-4a87-9769-284b92a71f37'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:48 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Deleted volume successfully. Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:48 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ae5056dd-9209-4644-a4e5-de86f62aae87 tempest-CreateVolumesFromImageTest-258166158 None] Lock "cinder-261a9dd6-ac39-4a0c-9315-202bd68ee86c-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:48 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:48 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398 1073741824" returned: 0 in 0.576s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:48 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398 Nov 05 22:35:48 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:48 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Deleted volume successfully. Nov 05 22:35:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-37a64646-0f3e-4401-9a42-d0c3b2552458 tempest-VolumeAndVolumeTypeFromImageTest-1345136680 None] Lock "cinder-a3ffb46a-1cf0-4658-92e1-32012cd96a0f-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:49 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398" returned: 0 in 0.288s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a41419e-d9b8-496e-8d2c-db74010fe364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c7bc7d-d627-49fc-b859-99b1afaa2121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:49 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Volume volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398 (febbbc5f-4351-4dc2-8ba4-d1cd8385e398): created successfully Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c7bc7d-d627-49fc-b859-99b1afaa2121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Flow 'volume_create_manager' (eebed973-6553-4d74-87a1-ad9e32bde833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:49 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a53894a0-51b3-4471-8dd0-583e8bc3f24a tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created volume successfully. Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-febbbc5f-4351-4dc2-8ba4-d1cd8385e398-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-febbbc5f-4351-4dc2-8ba4-d1cd8385e398-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-quobyte-febbbc5f-4351-4dc2-8ba4-d1cd8385e398" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-febbbc5f-4351-4dc2-8ba4-d1cd8385e398" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3064ada7-7f47-42e3-a4b9-2fa3f2b6302c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:49 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398 Nov 05 22:35:49 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:49 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:49 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398 Nov 05 22:35:49 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:50 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-febbbc5f-4351-4dc2-8ba4-d1cd8385e398" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-febbbc5f-4351-4dc2-8ba4-d1cd8385e398" released by "delete_volume" :: held 0.796s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created reservations ['438dd6eb-9be9-4f0c-96c1-eaa215e46897', 'aadcf576-f93d-436f-82c7-340ed926613d', '965ad45e-0f0c-477a-a627-734c2c551deb', '46a66e4c-ee1b-42f0-b6b0-709e9ffc6b0d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:50 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:50 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-469c467e-0440-4d19-a097-65ab6f75c038-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-469c467e-0440-4d19-a097-65ab6f75c038-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-quobyte-469c467e-0440-4d19-a097-65ab6f75c038" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-469c467e-0440-4d19-a097-65ab6f75c038" acquired by "delete_volume" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:50 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Deleted volume successfully. Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d23a394-8cfd-4a01-b03e-eb20b8010c0a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-101575dd-2615-4f29-8677-71f785fa540f tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-febbbc5f-4351-4dc2-8ba4-d1cd8385e398-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:50 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038 Nov 05 22:35:50 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:51 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038" returned: 0 in 0.527s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:51 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038 Nov 05 22:35:51 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:51 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-469c467e-0440-4d19-a097-65ab6f75c038" returned: 0 in 0.336s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-469c467e-0440-4d19-a097-65ab6f75c038" released by "delete_volume" :: held 0.954s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created reservations ['87f34e83-26ea-4fbd-8a6c-31b663d3609f', '1e3b554a-750e-4aa3-88cf-6a9953bdd87e', 'ab47395f-58f8-44b2-97ef-7a9f007781c5', 'a3ac1e77-819a-4211-9e51-37ddd12f1a26'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:51 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:51 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:52 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.355s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:52 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:52 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Deleted volume successfully. Nov 05 22:35:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b35a1ca0-8d5c-4fba-9f1d-9d50afc5dc99 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-469c467e-0440-4d19-a097-65ab6f75c038-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-1c6e805b-2d84-4577-9815-81e1576b94a4-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-1c6e805b-2d84-4577-9815-81e1576b94a4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-quobyte-1c6e805b-2d84-4577-9815-81e1576b94a4" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-1c6e805b-2d84-4577-9815-81e1576b94a4" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac30fbbf-1373-461f-a582-de9056d481b8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:53 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4 Nov 05 22:35:53 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:53 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4" returned: 0 in 0.466s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:53 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4 Nov 05 22:35:53 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:53 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1c6e805b-2d84-4577-9815-81e1576b94a4" returned: 0 in 0.355s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-1c6e805b-2d84-4577-9815-81e1576b94a4" released by "delete_volume" :: held 0.904s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:53 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (35b027bd-0b35-4b99-8a0d-72a9142461af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c012c0a-c8c1-4a3b-a394-62e63ba9d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c012c0a-c8c1-4a3b-a394-62e63ba9d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368792074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f25947-0a9c-4279-b836-c4bf9bb12f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:54Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25576c4-43d9-4da7-b0fa-dd286a2e0c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25576c4-43d9-4da7-b0fa-dd286a2e0c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14547e80-cbc9-48f3-a9af-286571fc94d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14547e80-cbc9-48f3-a9af-286571fc94d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f25947-0a9c-4279-b836-c4bf9bb12f8b', 'volume_name': 'volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebdceef-411d-45a9-a1de-99902f1584ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebdceef-411d-45a9-a1de-99902f1584ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd16a1da-cc1e-458b-abf7-95a4d4dab43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume e8f25947-0a9c-4279-b836-c4bf9bb12f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b', 'volume_size': 1} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368792074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f25947-0a9c-4279-b836-c4bf9bb12f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:54Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Creating volume e8f25947-0a9c-4279-b836-c4bf9bb12f8b {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:54 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:54 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b 1073741824 Nov 05 22:35:54 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (a277453e-3ad5-4a2c-91f4-e792ffbefeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0d1c88-7734-4d97-b86a-491a24a7c81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0d1c88-7734-4d97-b86a-491a24a7c81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1940613039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe4bbdd-5ee2-465f-b045-429149abee84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:54Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80f4df2-4615-421f-856b-0fa5c69ecd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80f4df2-4615-421f-856b-0fa5c69ecd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149b50ec-50e1-45df-b57a-129011a56792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149b50ec-50e1-45df-b57a-129011a56792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe4bbdd-5ee2-465f-b045-429149abee84', 'volume_name': 'volume-ebe4bbdd-5ee2-465f-b045-429149abee84', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f017b5a1-c511-40c2-8dfb-b366da585084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f017b5a1-c511-40c2-8dfb-b366da585084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ed7f55-75b1-4293-ad14-eb06a0528205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Volume ebe4bbdd-5ee2-465f-b045-429149abee84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe4bbdd-5ee2-465f-b045-429149abee84', 'volume_size': 1} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created reservations ['c5f1ce77-ed9e-4b68-b237-e9aaeb8bcaef', '26ceb7e5-9922-4960-9534-12d3f931462e', '4d152930-1b12-47bc-9246-056e7eb1d112', '7a0aa099-66ed-4a24-b434-0361c9985d12'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:54 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:54 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:54 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:54 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Deleted volume successfully. Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b 1073741824" returned: 0 in 0.502s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9cf1df63-4d98-44f5-b2da-29f24be11dde tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-1c6e805b-2d84-4577-9815-81e1576b94a4-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:54 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b Nov 05 22:35:54 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-quobyte-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf3346a-08fb-49a8-9115-a8353ba17525]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:55 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1940613039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe4bbdd-5ee2-465f-b045-429149abee84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:54Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Creating volume ebe4bbdd-5ee2-465f-b045-429149abee84 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:55 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:55 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d Nov 05 22:35:55 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd16a1da-cc1e-458b-abf7-95a4d4dab43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef76f80-3abb-4237-a66f-7ce2255f7153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:55 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 1073741824 Nov 05 22:35:55 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b (e8f25947-0a9c-4279-b836-c4bf9bb12f8b): created successfully Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef76f80-3abb-4237-a66f-7ce2255f7153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (35b027bd-0b35-4b99-8a0d-72a9142461af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b04705e9-5a6e-4231-be0d-741695271453 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created volume successfully. Nov 05 22:35:55 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d" returned: 0 in 0.438s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:55 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d Nov 05 22:35:55 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:55 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 1073741824" returned: 0 in 0.563s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Flow 'volume_create_manager' (43abd5a8-8426-40b5-beef-199a6c9074e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70aaf602-74c9-4960-9e28-a38d42311699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:55 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70aaf602-74c9-4960-9e28-a38d42311699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1300229949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318c8ccf-96c0-41ca-92ea-843c4594c247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecdc79649974687b7815c0216c5626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:56Z,use_quota=True,user_id='bc1005d36c4a40a6ae303cb6afd5753a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7d239f-624d-444e-8c5b-983aad9e8e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7d239f-624d-444e-8c5b-983aad9e8e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:55 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 Nov 05 22:35:55 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb733a85-7c1c-425d-b1a9-1ac822c22448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb733a85-7c1c-425d-b1a9-1ac822c22448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318c8ccf-96c0-41ca-92ea-843c4594c247', 'volume_name': 'volume-318c8ccf-96c0-41ca-92ea-843c4594c247', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da50e2db-d13d-4b46-90c3-d5e6d1131d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da50e2db-d13d-4b46-90c3-d5e6d1131d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a77cd41-de53-4928-b9f2-c5e2b0413182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Volume 318c8ccf-96c0-41ca-92ea-843c4594c247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318c8ccf-96c0-41ca-92ea-843c4594c247', 'volume_size': 1} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d" returned: 0 in 0.357s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d" released by "delete_volume" :: held 0.864s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created reservations ['8ce56389-55ce-4d97-884b-2dbc324e1630', 'b144951b-6644-4f1d-af7f-ee715680ccd3', '447f7e48-d6ad-4814-9c05-dfb38e0edb47', '22d9989b-0d99-4f90-83a5-59e9f0e4e5d4'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:55 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:55 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:55 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84" returned: 0 in 0.309s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.261s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1300229949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318c8ccf-96c0-41ca-92ea-843c4594c247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecdc79649974687b7815c0216c5626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:56Z,use_quota=True,user_id='bc1005d36c4a40a6ae303cb6afd5753a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Creating volume 318c8ccf-96c0-41ca-92ea-843c4594c247 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:56 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ed7f55-75b1-4293-ad14-eb06a0528205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe4bbdd-5ee2-465f-b045-429149abee84', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b8c1b3-2781-46a3-a2d9-147ef3175de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Volume volume-ebe4bbdd-5ee2-465f-b045-429149abee84 (ebe4bbdd-5ee2-465f-b045-429149abee84): created successfully Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b8c1b3-2781-46a3-a2d9-147ef3175de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (a277453e-3ad5-4a2c-91f4-e792ffbefeac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:56 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 1073741824 Nov 05 22:35:56 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-69743e88-d62d-49b0-b9bf-05e06dca97c9-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4e2eb466-516d-46d1-a35b-d72b4e0e435a tempest-ProjectMemberTests-19838403 None] Created volume successfully. Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-69743e88-d62d-49b0-b9bf-05e06dca97c9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-quobyte-69743e88-d62d-49b0-b9bf-05e06dca97c9" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-69743e88-d62d-49b0-b9bf-05e06dca97c9" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ec47c3-595d-4ee3-b3db-31a3cd406520]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:56 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Deleted volume successfully. Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a6227ca6-5284-43a5-989f-35b287495afc tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-8a7e9e0d-ad84-4fa5-a4d5-e1695f26779d-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:56 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9 Nov 05 22:35:56 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (95d29cfb-96ae-4430-9092-7b36fdbda5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d181ead7-f868-46a0-a8c3-fbb41d1cf5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d181ead7-f868-46a0-a8c3-fbb41d1cf5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971991256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f44e7c-276a-4c20-a460-61b7fdda8183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:56Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b59a5e2-dc1a-4a2d-858c-d36a86790c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b59a5e2-dc1a-4a2d-858c-d36a86790c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e236dd-c250-4069-b195-94cdca2f457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e236dd-c250-4069-b195-94cdca2f457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f44e7c-276a-4c20-a460-61b7fdda8183', 'volume_name': 'volume-a6f44e7c-276a-4c20-a460-61b7fdda8183', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b2e91a-f66b-4875-8ee7-7d35a915bc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b2e91a-f66b-4875-8ee7-7d35a915bc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad76505-76b7-4689-a785-65a6ef6cb6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:56 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume a6f44e7c-276a-4c20-a460-61b7fdda8183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f44e7c-276a-4c20-a460-61b7fdda8183', 'volume_size': 1} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:56 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 1073741824" returned: 0 in 0.655s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:56 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9" returned: 0 in 0.514s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:56 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 Nov 05 22:35:56 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:56 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9 Nov 05 22:35:56 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:56 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (cf367c01-aa4a-4f73-b558-e3785b6c0696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cda2625-c32c-4a30-9fb4-428ed02be970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cda2625-c32c-4a30-9fb4-428ed02be970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-540043975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cade13-ea46-457a-8ed6-7f3b60a50fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:57Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e053d31-cd6a-47d9-a5f1-af8b7b48b9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e053d31-cd6a-47d9-a5f1-af8b7b48b9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:57 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24460fbe-5c0f-49ab-9a4b-499d77a1c53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24460fbe-5c0f-49ab-9a4b-499d77a1c53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6cade13-ea46-457a-8ed6-7f3b60a50fc2', 'volume_name': 'volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27819fbf-49a4-49a9-b25a-e37e46392c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27819fbf-49a4-49a9-b25a-e37e46392c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a9c12f-768e-4dc3-8ae0-42f1f9f70bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume b6cade13-ea46-457a-8ed6-7f3b60a50fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2', 'volume_size': 1} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-69743e88-d62d-49b0-b9bf-05e06dca97c9" returned: 0 in 0.341s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971991256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f44e7c-276a-4c20-a460-61b7fdda8183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:56Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Creating volume a6f44e7c-276a-4c20-a460-61b7fdda8183 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:57 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a77cd41-de53-4928-b9f2-c5e2b0413182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318c8ccf-96c0-41ca-92ea-843c4594c247', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b041c5-c459-4abf-8315-c78e22f33d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-69743e88-d62d-49b0-b9bf-05e06dca97c9" released by "delete_volume" :: held 0.975s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:57 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183 1073741824 Nov 05 22:35:57 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:57 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Volume volume-318c8ccf-96c0-41ca-92ea-843c4594c247 (318c8ccf-96c0-41ca-92ea-843c4594c247): created successfully Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b041c5-c459-4abf-8315-c78e22f33d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Flow 'volume_create_manager' (43abd5a8-8426-40b5-beef-199a6c9074e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f77405de-99c8-4b31-9aed-e524e861a353 tempest-VolumeDependencyTests-1539093348 None] Created volume successfully. Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created reservations ['81261d04-f7db-4860-9669-a33a9a5b4cd0', '4d17cef6-ab71-4df5-92fd-7566133ae829', '2f9ae942-a4e4-41ea-96f4-5116d0f9154b', 'a037985d-1b4b-4ac5-af9c-dab90f7e2cf9'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:57 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:57 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (99544b62-fa83-4061-8c52-d8b69951eea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bce09e-5ead-45e2-b5a6-cdfaebeb1f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bce09e-5ead-45e2-b5a6-cdfaebeb1f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-992169677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326b28a3-84e6-4b63-9145-b73cd8a973cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:57Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dd9c13-174c-45dc-95c6-64b2ccedb3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7dd9c13-174c-45dc-95c6-64b2ccedb3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f80efcd-8bd0-4129-8760-742cbf9f21c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f80efcd-8bd0-4129-8760-742cbf9f21c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '326b28a3-84e6-4b63-9145-b73cd8a973cc', 'volume_name': 'volume-326b28a3-84e6-4b63-9145-b73cd8a973cc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76a22e5-5f15-4eac-a673-868630c0c73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76a22e5-5f15-4eac-a673-868630c0c73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d76e95-8801-4c32-8655-cf1d0fa85a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:57 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume 326b28a3-84e6-4b63-9145-b73cd8a973cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-326b28a3-84e6-4b63-9145-b73cd8a973cc', 'volume_size': 1} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:57 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:35:57 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-0317a7d6-b1e7-4872-b730-6f9eccd9055b-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-0317a7d6-b1e7-4872-b730-6f9eccd9055b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-quobyte-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-quobyte-0317a7d6-b1e7-4872-b730-6f9eccd9055b" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-0317a7d6-b1e7-4872-b730-6f9eccd9055b" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Deleting offline snapshot 0317a7d6-b1e7-4872-b730-6f9eccd9055b of volume 535fd1dc-b3d1-4fe7-b055-52d88ce48f97 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:35:57 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] snapshot_file for this snap is: volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183 1073741824" returned: 0 in 0.840s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a214dc9-608b-47b8-bfc1-8aaa57e427d0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:57 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.540s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (b8513f20-f332-44ac-9d66-10c4815ca02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e402a50-db0e-4e48-b7ac-9e6fcbb23b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Deleted volume successfully. Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e402a50-db0e-4e48-b7ac-9e6fcbb23b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797371325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e30b4cd-a303-43b4-97b4-30e6c19f132a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:58Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2023b9b5-58db-4cdb-ba22-0c64b57f4319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2023b9b5-58db-4cdb-ba22-0c64b57f4319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f4934c-dced-4128-89b0-4f3f60593627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f4934c-dced-4128-89b0-4f3f60593627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e30b4cd-a303-43b4-97b4-30e6c19f132a', 'volume_name': 'volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e757bf-a885-4892-b434-080eba703db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e757bf-a885-4892-b434-080eba703db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4bcaa2-055f-4a99-95e9-3c9308396207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume 3e30b4cd-a303-43b4-97b4-30e6c19f132a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a', 'volume_size': 1} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-e35202ab-42ed-4a7f-85d3-ad225d13c20d tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-69743e88-d62d-49b0-b9bf-05e06dca97c9-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.536s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:35:58 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b Nov 05 22:35:58 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:58 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183 Nov 05 22:35:58 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:58 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.389s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-540043975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cade13-ea46-457a-8ed6-7f3b60a50fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:57Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Creating volume b6cade13-ea46-457a-8ed6-7f3b60a50fc2 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:58 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:58 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2 1073741824 Nov 05 22:35:58 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad76505-76b7-4689-a785-65a6ef6cb6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f44e7c-276a-4c20-a460-61b7fdda8183', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d5838e-ff93-478a-b1ad-ec6c29838852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume volume-a6f44e7c-276a-4c20-a460-61b7fdda8183 (a6f44e7c-276a-4c20-a460-61b7fdda8183): created successfully Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d5838e-ff93-478a-b1ad-ec6c29838852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:58 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (95d29cfb-96ae-4430-9092-7b36fdbda5cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b" returned: 0 in 0.658s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (ebf1756f-fb6c-426b-8add-ef73900bf34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba7607e-1d4c-4b0c-8c96-517e0386dbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5873b780-7212-4dc6-9683-5449b12945d8]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-08481ff2-f444-4baa-9fbc-3e05eb13a841 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created volume successfully. Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba7607e-1d4c-4b0c-8c96-517e0386dbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678556508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898cae0a-fa6e-4ab8-8d2f-3f4562263f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:59Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a2214e-f1d7-4430-9ed3-6018ddd3aacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a2214e-f1d7-4430-9ed3-6018ddd3aacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf3ebd8-a6ff-45e8-bf78-e542d6fe7958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf3ebd8-a6ff-45e8-bf78-e542d6fe7958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '898cae0a-fa6e-4ab8-8d2f-3f4562263f26', 'volume_name': 'volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eba2b0f-1ddd-4f13-934b-f5fc58e93178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eba2b0f-1ddd-4f13-934b-f5fc58e93178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b03a54-7291-4595-83c8-8b4aed6c78d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume 898cae0a-fa6e-4ab8-8d2f-3f4562263f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26', 'volume_size': 1} Nov 05 22:35:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:58 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 Nov 05 22:35:58 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:59 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2 1073741824" returned: 0 in 0.523s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:59 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2 Nov 05 22:35:59 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:59 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" returned: 0 in 0.444s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:59 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b Nov 05 22:35:59 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:59 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2" returned: 0 in 0.255s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.665s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-992169677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=326b28a3-84e6-4b63-9145-b73cd8a973cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:57Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Creating volume 326b28a3-84e6-4b63-9145-b73cd8a973cc {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:59 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a9c12f-768e-4dc3-8ae0-42f1f9f70bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e180a8e-0f7d-42e6-b12e-1af82e488898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:59 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc 1073741824 Nov 05 22:35:59 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2 (b6cade13-ea46-457a-8ed6-7f3b60a50fc2): created successfully Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e180a8e-0f7d-42e6-b12e-1af82e488898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (cf367c01-aa4a-4f73-b558-e3785b6c0696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-3fd868aa-2823-48fe-955d-d6432a8d622f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created volume successfully. Nov 05 22:35:59 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b" returned: 0 in 0.397s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:59 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b Nov 05 22:35:59 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:59 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97.0317a7d6-b1e7-4872-b730-6f9eccd9055b" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:59 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc 1073741824" returned: 0 in 0.524s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-0317a7d6-b1e7-4872-b730-6f9eccd9055b" released by "_delete_snapshot" :: held 1.962s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" released by "delete_snapshot" :: held 2.017s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:59 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc Nov 05 22:35:59 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:59 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created reservations ['94ab2781-b518-4ff0-8ec1-10530d36ec10', 'ea716fab-7a3a-40d3-9197-a419032c8626', '9dd2edf8-b965-474c-ac35-dfe583fe42f9', '1479edf4-fef8-40a1-b918-a44a19d65802'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Delete snapshot completed successfully. Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ea748013-72e6-4645-a0f3-c8aaa2e67be5 tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-0317a7d6-b1e7-4872-b730-6f9eccd9055b-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:00 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.441s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Creating offline snapshot f46539d9-79f0-430b-b1e2-dbc95eb96d7d of volume ebe4bbdd-5ee2-465f-b045-429149abee84 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d76e95-8801-4c32-8655-cf1d0fa85a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-326b28a3-84e6-4b63-9145-b73cd8a973cc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35504bd6-ede6-4bfe-bed0-0bc2e2079ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6975691-cce1-4125-b191-27b6fa9b0b90]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:00 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume volume-326b28a3-84e6-4b63-9145-b73cd8a973cc (326b28a3-84e6-4b63-9145-b73cd8a973cc): created successfully Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35504bd6-ede6-4bfe-bed0-0bc2e2079ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (99544b62-fa83-4061-8c52-d8b69951eea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9b446d47-1e8a-493b-b348-59314629cb2b tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created volume successfully. Nov 05 22:36:00 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 Nov 05 22:36:00 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:00 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84" returned: 0 in 0.413s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:00 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d 1G Nov 05 22:36:00 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:01 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d 1G" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe4bbdd-5ee2-465f-b045-429149abee84 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:01 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe4bbdd-5ee2-465f-b045-429149abee84 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d Nov 05 22:36:01 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-535fd1dc-b3d1-4fe7-b055-52d88ce48f97-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-535fd1dc-b3d1-4fe7-b055-52d88ce48f97-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "cinder-quobyte-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b942db88-04e2-4ec2-90e2-70fadc85199d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:01 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe4bbdd-5ee2-465f-b045-429149abee84 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d" returned: 0 in 0.285s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:01 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d is being set with open permissions: ugo+rw Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:01 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 Nov 05 22:36:01 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:01 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d Nov 05 22:36:01 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:01 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:01 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:01 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.info Nov 05 22:36:01 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:01 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97 Nov 05 22:36:01 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:01 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.info" returned: 0 in 0.276s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:01 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.info is being set with open permissions: ugo+rw Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:01 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:01 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.info Nov 05 22:36:01 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-quobyte-535fd1dc-b3d1-4fe7-b055-52d88ce48f97" released by "delete_volume" :: held 0.734s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Created reservations ['c3b15261-ce06-4dd1-b0bc-568a395e1a72', 'df700739-acc4-4d4b-b14b-f6eaed51032b', '58bf0f7d-cd81-4bb9-8d8d-1cbce78ea731', 'ded756e3-2f2a-457a-a5a5-e64bae82c69e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:02 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:02 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:02 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.info" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.967s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797371325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e30b4cd-a303-43b4-97b4-30e6c19f132a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:58Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Creating volume 3e30b4cd-a303-43b4-97b4-30e6c19f132a {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:02 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:02 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a 1073741824 Nov 05 22:36:02 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-65e3884b-c528-40b1-bc81-5ac9081d4d3c tempest-ProjectMemberTests-19838403 None] Create snapshot completed successfully Nov 05 22:36:02 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.272s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Deleted volume successfully. Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-56f19525-9640-47e9-8d1f-d9385f84468c tempest-CreateVolumesFromSnapshotTest-1148005579 None] Lock "cinder-535fd1dc-b3d1-4fe7-b055-52d88ce48f97-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:02 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a 1073741824" returned: 0 in 0.497s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:02 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a Nov 05 22:36:02 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-f46539d9-79f0-430b-b1e2-dbc95eb96d7d-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-f46539d9-79f0-430b-b1e2-dbc95eb96d7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-ebe4bbdd-5ee2-465f-b045-429149abee84" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-ebe4bbdd-5ee2-465f-b045-429149abee84" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-f46539d9-79f0-430b-b1e2-dbc95eb96d7d" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-f46539d9-79f0-430b-b1e2-dbc95eb96d7d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Deleting offline snapshot f46539d9-79f0-430b-b1e2-dbc95eb96d7d of volume ebe4bbdd-5ee2-465f-b045-429149abee84 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] snapshot_file for this snap is: volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:02 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a" returned: 0 in 0.302s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ba6eee-1f91-4d79-b0e2-714a74c93505]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.366s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Creating offline snapshot 1b3d3b8e-5713-4775-bf49-345633843318 of volume 318c8ccf-96c0-41ca-92ea-843c4594c247 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4bcaa2-055f-4a99-95e9-3c9308396207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad04f98-ddd8-492f-a66c-6cfa1a821150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d571fd-8676-4f3f-9fa2-a40d76c4820a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a (3e30b4cd-a303-43b4-97b4-30e6c19f132a): created successfully Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad04f98-ddd8-492f-a66c-6cfa1a821150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (b8513f20-f332-44ac-9d66-10c4815ca02e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-739630cf-2f94-4093-a2e7-66117f37341f tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created volume successfully. Nov 05 22:36:03 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d Nov 05 22:36:03 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:03 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 Nov 05 22:36:03 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:03 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d" returned: 0 in 0.411s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebe4bbdd-5ee2-465f-b045-429149abee84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9963a9c6-85fa-463d-9fc0-5aa9d958f939]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:03 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247" returned: 0 in 0.472s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:03 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 1G Nov 05 22:36:03 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:03 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 Nov 05 22:36:03 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:03 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84" returned: 0 in 0.492s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:03 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d Nov 05 22:36:03 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:04 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 1G" returned: 0 in 0.489s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318c8ccf-96c0-41ca-92ea-843c4594c247 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:04 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318c8ccf-96c0-41ca-92ea-843c4594c247 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 Nov 05 22:36:04 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:04 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:04 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318c8ccf-96c0-41ca-92ea-843c4594c247 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:04 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 is being set with open permissions: ugo+rw Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:04 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d Nov 05 22:36:04 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:04 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 Nov 05 22:36:04 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:04 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84.f46539d9-79f0-430b-b1e2-dbc95eb96d7d" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:04 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318" returned: 0 in 0.281s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-f46539d9-79f0-430b-b1e2-dbc95eb96d7d" released by "_delete_snapshot" :: held 1.697s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-ebe4bbdd-5ee2-465f-b045-429149abee84" released by "delete_snapshot" :: held 1.733s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:04 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.info Nov 05 22:36:04 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Created reservations ['c3f98201-a7e1-4b7f-bfcb-14ebb27eab9d', '780916d8-3ef0-47f6-bc3e-e88f19760dc7', '45a152fd-c515-4fa7-8a8b-ea48b9e7d833', '9c47d0f2-3f02-48ea-a4d7-d8db40b0767c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:04 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Delete snapshot completed successfully. Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-10e3c215-260b-4c63-b6bc-0c2e574067d3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-f46539d9-79f0-430b-b1e2-dbc95eb96d7d-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:04 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.info" returned: 0 in 0.276s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:04 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.info is being set with open permissions: ugo+rw Nov 05 22:36:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:04 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.info Nov 05 22:36:04 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-ebe4bbdd-5ee2-465f-b045-429149abee84-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Lock "cinder-ebe4bbdd-5ee2-465f-b045-429149abee84-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-ebe4bbdd-5ee2-465f-b045-429149abee84" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-ebe4bbdd-5ee2-465f-b045-429149abee84" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a54bf6-d015-4b56-92e2-d52857d1de0b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:05 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.info" returned: 0 in 0.297s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.512s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1678556508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=898cae0a-fa6e-4ab8-8d2f-3f4562263f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40ff9cdd774a3ab8fed3655a78f3bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:59Z,use_quota=True,user_id='bafe7a7a4b4e4089aa55b6ef5c98360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Creating volume 898cae0a-fa6e-4ab8-8d2f-3f4562263f26 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:05 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:05 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26 1073741824 Nov 05 22:36:05 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2ddded66-db6e-43b2-80b1-69ba824241ae tempest-VolumeDependencyTests-1539093348 None] Create snapshot completed successfully Nov 05 22:36:05 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 Nov 05 22:36:05 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:05 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84" returned: 0 in 0.414s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:05 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84 Nov 05 22:36:05 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:05 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26 1073741824" returned: 0 in 0.553s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:05 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26 Nov 05 22:36:05 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:05 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-ebe4bbdd-5ee2-465f-b045-429149abee84" returned: 0 in 0.331s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-ebe4bbdd-5ee2-465f-b045-429149abee84" released by "delete_volume" :: held 0.842s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Created reservations ['23dbb754-4cf7-467b-9712-1978994320f7', 'f9dfb73f-8143-47c7-afff-ee4eed6826e7', 'de7311ff-f8c4-4d7b-b16f-6940dbe8dd4e', '2afe86bd-d722-4007-befc-d675a54dbccb'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:06 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26" returned: 0 in 0.340s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:06 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:06 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b03a54-7291-4595-83c8-8b4aed6c78d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e767c411-a8aa-43ab-bec7-2dee774cdeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Volume volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26 (898cae0a-fa6e-4ab8-8d2f-3f4562263f26): created successfully Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e767c411-a8aa-43ab-bec7-2dee774cdeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Flow 'volume_create_manager' (ebf1756f-fb6c-426b-8add-ef73900bf34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-579aab6e-975a-4934-86d8-74fb92817f97 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created volume successfully. Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Flow 'volume_create_manager' (4156abc9-9fdb-4789-a6ea-2ae71a570971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30931a1-7cef-4d96-90e9-04a87b3d8c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30931a1-7cef-4d96-90e9-04a87b3d8c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-299156828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5a36e9-ae50-4a71-8a8b-290067852b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ecdc79649974687b7815c0216c5626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b3d3b8e-5713-4775-bf49-345633843318,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:06Z,use_quota=True,user_id='bc1005d36c4a40a6ae303cb6afd5753a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd7d5cb-58e1-4c66-bab9-2032bde67a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd7d5cb-58e1-4c66-bab9-2032bde67a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c31aa19-fdfe-4cbe-9695-90a07203a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c31aa19-fdfe-4cbe-9695-90a07203a773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f5a36e9-ae50-4a71-8a8b-290067852b79', 'volume_name': 'volume-5f5a36e9-ae50-4a71-8a8b-290067852b79', 'volume_size': 1, 'snapshot_id': '1b3d3b8e-5713-4775-bf49-345633843318'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae1763f-0192-461a-b7c9-435a615430c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae1763f-0192-461a-b7c9-435a615430c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bf4d09-fb8c-4378-9cd4-97f5eeae7175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Volume 5f5a36e9-ae50-4a71-8a8b-290067852b79: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f5a36e9-ae50-4a71-8a8b-290067852b79', 'volume_size': 1, 'snapshot_id': '1b3d3b8e-5713-4775-bf49-345633843318'} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "cinder-quobyte-1b3d3b8e-5713-4775-bf49-345633843318-5f5a36e9-ae50-4a71-8a8b-290067852b79" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-1b3d3b8e-5713-4775-bf49-345633843318-5f5a36e9-ae50-4a71-8a8b-290067852b79" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Creating volume 5f5a36e9-ae50-4a71-8a8b-290067852b79 from snapshot 1b3d3b8e-5713-4775-bf49-345633843318 {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "cinder-quobyte-5f5a36e9-ae50-4a71-8a8b-290067852b79" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-5f5a36e9-ae50-4a71-8a8b-290067852b79" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] snapshot: 1b3d3b8e-5713-4775-bf49-345633843318, volume: 5f5a36e9-ae50-4a71-8a8b-290067852b79, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:36:06 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.342s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Deleted volume successfully. Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc0fc9e-6125-4355-8c2b-5010b544e0fc]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ab473c9e-25c9-412d-887e-e71246faf3e5 tempest-ProjectMemberTests-19838403 None] Lock "cinder-ebe4bbdd-5ee2-465f-b045-429149abee84-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:06 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 Nov 05 22:36:06 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (849d4df6-f2f4-49b7-864a-f2b4cdb97180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4716b6fb-8909-4d7a-8e33-08b7c8bc5868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4716b6fb-8909-4d7a-8e33-08b7c8bc5868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340478425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599e0d29-bc1e-48c2-88ea-8aef5b48cb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:07Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfb3f0f-7f13-4969-a97a-43156de0e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfb3f0f-7f13-4969-a97a-43156de0e10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a565a9-a7d9-4d77-9c37-2fcdd527c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a565a9-a7d9-4d77-9c37-2fcdd527c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599e0d29-bc1e-48c2-88ea-8aef5b48cb60', 'volume_name': 'volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48611b4-8a23-4887-bff4-157191b03184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48611b4-8a23-4887-bff4-157191b03184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6af849-2593-4820-a32a-33b5eb57c5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:06 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Volume 599e0d29-bc1e-48c2-88ea-8aef5b48cb60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60', 'volume_size': 1} Nov 05 22:36:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:07 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-318c8ccf-96c0-41ca-92ea-843c4594c247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c95f9dc-812e-4c04-b0b9-e75134354b65]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:07 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 Nov 05 22:36:07 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-898cae0a-fa6e-4ab8-8d2f-3f4562263f26-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-898cae0a-fa6e-4ab8-8d2f-3f4562263f26-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-quobyte-898cae0a-fa6e-4ab8-8d2f-3f4562263f26" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-898cae0a-fa6e-4ab8-8d2f-3f4562263f26" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ef5c44-bcb4-412a-9574-efdff9906521]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:07 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247" returned: 0 in 0.399s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:07 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26 Nov 05 22:36:07 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:07 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 Nov 05 22:36:07 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:07 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26" returned: 0 in 0.427s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:07 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26 Nov 05 22:36:07 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:08 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-898cae0a-fa6e-4ab8-8d2f-3f4562263f26" returned: 0 in 0.402s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-898cae0a-fa6e-4ab8-8d2f-3f4562263f26" released by "delete_volume" :: held 0.894s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created reservations ['0295b126-4d6c-47f0-9478-04f23fbc247e', 'e7a7ed5f-011a-4374-8529-2e86cf8c1f07', '86fe2660-8364-49bd-8df5-384239885066', '752b1828-e2dd-42d0-8307-4c65cafead04'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:08 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:08 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-3e30b4cd-a303-43b4-97b4-30e6c19f132a-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-3e30b4cd-a303-43b4-97b4-30e6c19f132a-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-quobyte-3e30b4cd-a303-43b4-97b4-30e6c19f132a" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-3e30b4cd-a303-43b4-97b4-30e6c19f132a" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[adff805e-a99b-4deb-a022-257ac262382d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:09 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.468s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:09 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Deleted volume successfully. Nov 05 22:36:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a371ef9e-bc6a-4adf-95bd-6134a8b31069 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-898cae0a-fa6e-4ab8-8d2f-3f4562263f26-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:09 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a Nov 05 22:36:09 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:09 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a" returned: 0 in 0.612s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:09 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a Nov 05 22:36:09 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:10 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e30b4cd-a303-43b4-97b4-30e6c19f132a" returned: 0 in 0.718s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:10 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-3e30b4cd-a303-43b4-97b4-30e6c19f132a" released by "delete_volume" :: held 1.467s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:10 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created reservations ['478509a1-bf64-4c88-87bd-53df6de20b8f', '9f166376-9436-42b7-aaf8-3cc233526bd3', '4c8370f9-73e1-428b-89ad-3062fb83b2a1', '8b0b0daa-49a2-4374-9505-97d178e434b7'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:10 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:10 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:10 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:11 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.506s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:11 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:11 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Deleted volume successfully. Nov 05 22:36:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b7e92bf9-d663-4cce-ad82-eedfd7a97f51 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-3e30b4cd-a303-43b4-97b4-30e6c19f132a-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-326b28a3-84e6-4b63-9145-b73cd8a973cc-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-326b28a3-84e6-4b63-9145-b73cd8a973cc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-quobyte-326b28a3-84e6-4b63-9145-b73cd8a973cc" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-326b28a3-84e6-4b63-9145-b73cd8a973cc" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:11 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[455db4f5-77e4-40e5-b443-484d53b19c33]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:11 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc Nov 05 22:36:11 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:12 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc" returned: 0 in 0.641s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:12 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc Nov 05 22:36:12 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:12 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-326b28a3-84e6-4b63-9145-b73cd8a973cc" returned: 0 in 0.459s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-326b28a3-84e6-4b63-9145-b73cd8a973cc" released by "delete_volume" :: held 1.205s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created reservations ['e22d1ea3-ed48-4d5a-8686-8365ab0ea649', '65b32257-8587-4493-a286-cc37ab42861a', 'f93aa234-7cc5-496c-8602-78c26748ce39', 'ec529ed1-d667-4bff-a238-2d9af8b2669a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:12 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:12 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:13 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.552s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:13 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Deleted volume successfully. Nov 05 22:36:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-d882a246-6c3a-460d-a31e-af7588b5d6e7 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-326b28a3-84e6-4b63-9145-b73cd8a973cc-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-b6cade13-ea46-457a-8ed6-7f3b60a50fc2-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-b6cade13-ea46-457a-8ed6-7f3b60a50fc2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-quobyte-b6cade13-ea46-457a-8ed6-7f3b60a50fc2" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-b6cade13-ea46-457a-8ed6-7f3b60a50fc2" acquired by "delete_volume" :: waited 0.043s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcf04a4-86c6-4f39-b62c-bf9aac19792c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:14 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2 Nov 05 22:36:14 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Flow 'volume_create_manager' (9aea97ae-c194-4f6b-8122-1143a2250e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b24eaf-5c8c-44ee-98ee-aaa3ec69e033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b24eaf-5c8c-44ee-98ee-aaa3ec69e033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-860272176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f0e569-0a0e-437d-97d9-3bc04beb8c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bb0348fd4a4beca6a6bc1eeabe8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:14Z,use_quota=True,user_id='3afa52ea25444c6784be0469fb2a8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737ea274-80fb-4f75-b410-ddbd8b802d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737ea274-80fb-4f75-b410-ddbd8b802d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4eebf8-f268-45eb-a313-88eeb61d19e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4eebf8-f268-45eb-a313-88eeb61d19e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f0e569-0a0e-437d-97d9-3bc04beb8c43', 'volume_name': 'volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e368ff40-0181-4796-a963-c56637565025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e368ff40-0181-4796-a963-c56637565025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40bf641-dd17-4ae5-aa72-d4fdd9ce967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:14 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Volume 14f0e569-0a0e-437d-97d9-3bc04beb8c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43', 'volume_size': 1} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:14 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2" returned: 0 in 0.775s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:14 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2 Nov 05 22:36:14 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:15 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b6cade13-ea46-457a-8ed6-7f3b60a50fc2" returned: 0 in 0.549s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-b6cade13-ea46-457a-8ed6-7f3b60a50fc2" released by "delete_volume" :: held 1.432s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created reservations ['34262f47-47e6-49c6-b1df-1b8c712aa651', 'ad37b8df-6f22-4b13-8aed-6f4ee375197d', 'b320a474-3943-437d-9c00-4108c4823a06', 'cfcd39f0-0d91-483f-8d85-6681b31c01d1'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:15 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:15 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:15 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.332s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:15 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Deleted volume successfully. Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6c9a4864-cb84-444b-ac34-73f72cc8bea5 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-b6cade13-ea46-457a-8ed6-7f3b60a50fc2-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:15 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79" returned: 0 in 8.428s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:36:15 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Converted 1024.00 MB image at 121.48 MB/s Nov 05 22:36:15 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 is being set with open permissions: ugo+rw Nov 05 22:36:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:15 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 Nov 05 22:36:15 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-a6f44e7c-276a-4c20-a460-61b7fdda8183-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-a6f44e7c-276a-4c20-a460-61b7fdda8183-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-quobyte-a6f44e7c-276a-4c20-a460-61b7fdda8183" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-a6f44e7c-276a-4c20-a460-61b7fdda8183" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee37fde3-f5e4-4fab-bb52-e43122affb7e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:16 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79" returned: 0 in 0.258s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-5f5a36e9-ae50-4a71-8a8b-290067852b79" released by "_copy_volume_from_snapshot" :: held 9.655s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:16 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183 Nov 05 22:36:16 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-1b3d3b8e-5713-4775-bf49-345633843318-5f5a36e9-ae50-4a71-8a8b-290067852b79" released by "_create_volume_from_snapshot" :: held 9.718s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.737s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.289s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340478425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599e0d29-bc1e-48c2-88ea-8aef5b48cb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:07Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Creating volume 599e0d29-bc1e-48c2-88ea-8aef5b48cb60 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:16 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:16 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 1073741824 Nov 05 22:36:16 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bf4d09-fb8c-4378-9cd4-97f5eeae7175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5a36e9-ae50-4a71-8a8b-290067852b79', 'volume_size': 1, 'snapshot_id': '1b3d3b8e-5713-4775-bf49-345633843318'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3371ca1-b3bf-4ce3-9b8c-c73d350334dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Volume volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 (5f5a36e9-ae50-4a71-8a8b-290067852b79): created successfully Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3371ca1-b3bf-4ce3-9b8c-c73d350334dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Flow 'volume_create_manager' (4156abc9-9fdb-4789-a6ea-2ae71a570971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f2e54731-36d4-4d32-a9c0-75e0dbf82cd8 tempest-VolumeDependencyTests-1539093348 None] Created volume successfully. Nov 05 22:36:16 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183" returned: 0 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:16 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183 Nov 05 22:36:16 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:16 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 1073741824" returned: 0 in 0.454s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:16 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-a6f44e7c-276a-4c20-a460-61b7fdda8183" returned: 0 in 0.271s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:16 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 Nov 05 22:36:16 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-a6f44e7c-276a-4c20-a460-61b7fdda8183" released by "delete_volume" :: held 0.712s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created reservations ['cf1963b0-a014-4b12-b4b9-a13d2fbbefcd', 'acd06bd8-9d4d-4fa2-a9b5-84b27d04d12a', '36e5cf12-0ba5-4e86-bd25-e6a382fdc1d5', 'f91b39e7-bf42-4379-be18-fb1b55e7b401'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:16 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:16 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:17 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" returned: 0 in 0.256s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.600s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-860272176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f0e569-0a0e-437d-97d9-3bc04beb8c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bb0348fd4a4beca6a6bc1eeabe8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:14Z,use_quota=True,user_id='3afa52ea25444c6784be0469fb2a8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Creating volume 14f0e569-0a0e-437d-97d9-3bc04beb8c43 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:17 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6af849-2593-4820-a32a-33b5eb57c5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b7b7eb-f703-4c63-afe7-ff65ca71a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:17 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 1073741824 Nov 05 22:36:17 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Volume volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 (599e0d29-bc1e-48c2-88ea-8aef5b48cb60): created successfully Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b7b7eb-f703-4c63-afe7-ff65ca71a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (849d4df6-f2f4-49b7-864a-f2b4cdb97180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0e2f7fe6-2833-4365-89ba-805e46a5159f tempest-ProjectMemberTests-19838403 None] Created volume successfully. Nov 05 22:36:17 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-e8f25947-0a9c-4279-b836-c4bf9bb12f8b-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:17 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Deleted volume successfully. Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-e8f25947-0a9c-4279-b836-c4bf9bb12f8b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-303f5756-04d0-4080-987f-5199b6e4eff3 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-a6f44e7c-276a-4c20-a460-61b7fdda8183-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "cinder-quobyte-e8f25947-0a9c-4279-b836-c4bf9bb12f8b" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-e8f25947-0a9c-4279-b836-c4bf9bb12f8b" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[14619c51-6173-42a0-8291-2399a58502d0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "cinder-1b3d3b8e-5713-4775-bf49-345633843318-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-1b3d3b8e-5713-4775-bf49-345633843318-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "cinder-quobyte-318c8ccf-96c0-41ca-92ea-843c4594c247" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-318c8ccf-96c0-41ca-92ea-843c4594c247" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "cinder-quobyte-1b3d3b8e-5713-4775-bf49-345633843318" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-1b3d3b8e-5713-4775-bf49-345633843318" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Deleting offline snapshot 1b3d3b8e-5713-4775-bf49-345633843318 of volume 318c8ccf-96c0-41ca-92ea-843c4594c247 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] snapshot_file for this snap is: volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:17 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b Nov 05 22:36:17 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5102c93-3088-4143-acbb-17167b8b6928]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:17 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 1073741824" returned: 0 in 0.550s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:17 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 Nov 05 22:36:17 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:17 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 Nov 05 22:36:17 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:17 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b" returned: 0 in 0.406s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:17 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b Nov 05 22:36:17 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:17 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43" returned: 0 in 0.282s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:17 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318" returned: 0 in 0.410s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-318c8ccf-96c0-41ca-92ea-843c4594c247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d40bf641-dd17-4ae5-aa72-d4fdd9ce967b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189d298b-272e-4588-8b3b-1256caeb10b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9304b347-73b1-4c30-93fe-5f30657f471a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:17 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Volume volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 (14f0e569-0a0e-437d-97d9-3bc04beb8c43): created successfully Nov 05 22:36:17 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189d298b-272e-4588-8b3b-1256caeb10b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Flow 'volume_create_manager' (9aea97ae-c194-4f6b-8122-1143a2250e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8e38ef3f-c93e-481f-a698-e6bee8fd764b tempest-ProjectReaderTests-1671521057 None] Created volume successfully. Nov 05 22:36:18 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-e8f25947-0a9c-4279-b836-c4bf9bb12f8b" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-quobyte-e8f25947-0a9c-4279-b836-c4bf9bb12f8b" released by "delete_volume" :: held 0.753s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:18 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 Nov 05 22:36:18 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Created reservations ['cbeb4770-bb35-4dba-bafa-0d2a75be4d33', '8f684559-8c1e-4d40-bf93-24e5f8adf8f8', 'e3a5a44c-c21d-46a5-9893-b833d5d2cfc3', '6c1cb8e3-1c62-4160-b0b4-625eb7ff89eb'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Creating offline snapshot 0607eb15-75d8-4659-bfa8-eff60d80f830 of volume 599e0d29-bc1e-48c2-88ea-8aef5b48cb60 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9588c5-ef4c-4af4-9d5e-b17a3f0bf19e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:18 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:18 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:18 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 Nov 05 22:36:18 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:18 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247" returned: 0 in 0.622s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:18 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:18 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 Nov 05 22:36:18 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:18 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Deleted volume successfully. Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7dfe8d46-86df-473f-aeda-8cd9dd773a22 tempest-CreateVolumesFromSourceVolumeTest-1301683328 None] Lock "cinder-e8f25947-0a9c-4279-b836-c4bf9bb12f8b-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:18 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" returned: 0 in 0.522s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:18 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 1G Nov 05 22:36:18 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:19 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318" returned: 0 in 0.450s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:19 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318 Nov 05 22:36:19 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:19 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 1G" returned: 0 in 0.526s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:19 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 Nov 05 22:36:19 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:19 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247.1b3d3b8e-5713-4775-bf49-345633843318" returned: 0 in 0.285s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-1b3d3b8e-5713-4775-bf49-345633843318" released by "_delete_snapshot" :: held 1.900s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-318c8ccf-96c0-41ca-92ea-843c4594c247" released by "delete_snapshot" :: held 1.929s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Created reservations ['1b850ad7-4ecd-4343-82bb-5a0b270a5139', 'a68dd507-cf9f-44b9-b406-237c00a8d9cd', '1145d55a-b664-4b18-841c-f79ee258f375', 'da156885-42b4-497a-a212-3bc81642a256'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Delete snapshot completed successfully. Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-465c6926-8ddc-4e8a-9249-4fb15f46086b tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-1b3d3b8e-5713-4775-bf49-345633843318-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "cinder-318c8ccf-96c0-41ca-92ea-843c4594c247-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-318c8ccf-96c0-41ca-92ea-843c4594c247-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:19 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830" returned: 0 in 0.395s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:19 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 is being set with open permissions: ugo+rw Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:19 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 Nov 05 22:36:19 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "cinder-quobyte-318c8ccf-96c0-41ca-92ea-843c4594c247" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-318c8ccf-96c0-41ca-92ea-843c4594c247" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[def4433d-dc86-46a6-bd7b-2bbf2b386012]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:19 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 Nov 05 22:36:19 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:19 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:20 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.info Nov 05 22:36:20 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:20 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247" returned: 0 in 0.476s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:20 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247 Nov 05 22:36:20 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:20 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.info" returned: 0 in 0.323s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:20 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.info is being set with open permissions: ugo+rw Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:20 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.info Nov 05 22:36:20 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:20 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-318c8ccf-96c0-41ca-92ea-843c4594c247" returned: 0 in 0.270s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-318c8ccf-96c0-41ca-92ea-843c4594c247" released by "delete_volume" :: held 0.834s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:20 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.info" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.441s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.657s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Created reservations ['973d7052-73c6-49f1-9615-3060f053a219', '04b93401-eec0-4ad9-b4dd-c2d39bf7008d', 'e1d3634f-0631-4afa-bc2a-83daf9560184', 'a08fdc1c-5026-48ba-8bee-37f77072973b'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Creating offline snapshot 69bd80eb-caf0-4e54-bb19-41669387d6ef of volume 14f0e569-0a0e-437d-97d9-3bc04beb8c43 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:20 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-30ae257b-25b6-42eb-b05e-5002c434ef46 tempest-ProjectMemberTests-19838403 None] Create snapshot completed successfully Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a8d9b-8ccc-496b-8300-c79750589a52]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:20 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:20 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "cinder-5f5a36e9-ae50-4a71-8a8b-290067852b79-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:20 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 Nov 05 22:36:20 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-5f5a36e9-ae50-4a71-8a8b-290067852b79-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "cinder-quobyte-5f5a36e9-ae50-4a71-8a8b-290067852b79" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-5f5a36e9-ae50-4a71-8a8b-290067852b79" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[04498065-147a-4f9a-a953-4e12e900c00e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:21 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 Nov 05 22:36:21 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:21 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.351s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Deleted volume successfully. Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4bdbf044-d04d-42a0-b711-4711847ee026 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-318c8ccf-96c0-41ca-92ea-843c4594c247-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:21 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43" returned: 0 in 0.516s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:21 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef 1G Nov 05 22:36:21 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-0607eb15-75d8-4659-bfa8-eff60d80f830-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Lock "cinder-0607eb15-75d8-4659-bfa8-eff60d80f830-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-0607eb15-75d8-4659-bfa8-eff60d80f830" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-0607eb15-75d8-4659-bfa8-eff60d80f830" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Deleting offline snapshot 0607eb15-75d8-4659-bfa8-eff60d80f830 of volume 599e0d29-bc1e-48c2-88ea-8aef5b48cb60 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] snapshot_file for this snap is: volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:21 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f370dfd7-6e90-4bf9-95e6-7f35cad27dee]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79" returned: 0 in 0.489s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:21 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79 Nov 05 22:36:21 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:21 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 Nov 05 22:36:21 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:21 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef 1G" returned: 0 in 0.527s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:21 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef Nov 05 22:36:21 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:21 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-5f5a36e9-ae50-4a71-8a8b-290067852b79" returned: 0 in 0.314s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-quobyte-5f5a36e9-ae50-4a71-8a8b-290067852b79" released by "delete_volume" :: held 0.887s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:21 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Created reservations ['31c28fdb-1672-4a57-bfd7-42464cf2ea4b', 'ed7691c0-a2c1-46e9-a0e3-896b7e621016', 'fe028c49-cadf-4be5-9140-baeaa8f79098', 'e2927365-6568-4069-9b9c-e1892b24ab32'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:22 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830" returned: 0 in 0.536s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0602fcc7-34ee-4324-9f96-3d6dbd588a29]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:22 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef" returned: 0 in 0.411s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:22 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:22 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef is being set with open permissions: ugo+rw Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:22 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:22 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef Nov 05 22:36:22 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Flow 'volume_create_manager' (35abc457-c5d0-4cd3-b140-c1a9b0619aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da66fbb-5547-43bd-ad05-ea33ec2f3c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:22 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da66fbb-5547-43bd-ad05-ea33ec2f3c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3af7c2-cf50-4cce-b350-3698d70fe2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f241248349874958bd2c797368278cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:22Z,use_quota=True,user_id='0ad909e8564c4664b76fb0d5525c6a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:22 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30327d92-9880-4d88-a390-351320d64ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30327d92-9880-4d88-a390-351320d64ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd383f6-ec69-4145-a648-fa38faadd381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd383f6-ec69-4145-a648-fa38faadd381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3af7c2-cf50-4cce-b350-3698d70fe2d8', 'volume_name': 'volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5857b0f8-7f97-4da5-900a-06c843efc04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5857b0f8-7f97-4da5-900a-06c843efc04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf072120-6b05-41a6-b1f5-8f66d1a5239d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:22 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Volume 0d3af7c2-cf50-4cce-b350-3698d70fe2d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8', 'volume_size': 1} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:22 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.256s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:22 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Deleted volume successfully. Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ca805396-ccef-4bab-9948-f766ece721a9 tempest-VolumeDependencyTests-1539093348 None] Lock "cinder-5f5a36e9-ae50-4a71-8a8b-290067852b79-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:22 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:22 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.info Nov 05 22:36:22 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:22 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" returned: 0 in 0.395s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:22 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 Nov 05 22:36:22 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:22 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.info" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:22 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.info is being set with open permissions: ugo+rw Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:22 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.info Nov 05 22:36:22 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:22 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:22 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830 Nov 05 22:36:22 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:22 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.info" returned: 0 in 0.239s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.715s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3af7c2-cf50-4cce-b350-3698d70fe2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f241248349874958bd2c797368278cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:22Z,use_quota=True,user_id='0ad909e8564c4664b76fb0d5525c6a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Creating volume 0d3af7c2-cf50-4cce-b350-3698d70fe2d8 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:22 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:23 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8 1073741824 Nov 05 22:36:23 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-dd05aa10-6681-4af6-ae22-0a7837aa9661 tempest-ProjectReaderTests-1671521057 None] Create snapshot completed successfully Nov 05 22:36:23 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60.0607eb15-75d8-4659-bfa8-eff60d80f830" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-0607eb15-75d8-4659-bfa8-eff60d80f830" released by "_delete_snapshot" :: held 1.708s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" released by "delete_snapshot" :: held 1.743s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Created reservations ['7af3366e-40fe-4792-9bb0-972859821de3', 'c2a6f140-2f61-4322-9930-2290b76d00cb', 'a54465e1-b414-48ed-ac47-79a1677903ea', '16f556ee-4c54-43ca-863c-065f9d0bf2a6'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Delete snapshot completed successfully. Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-fd577be9-b314-45ae-9588-fae4c64db20f tempest-ProjectMemberTests-19838403 None] Lock "cinder-0607eb15-75d8-4659-bfa8-eff60d80f830-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-69bd80eb-caf0-4e54-bb19-41669387d6ef-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-69bd80eb-caf0-4e54-bb19-41669387d6ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-14f0e569-0a0e-437d-97d9-3bc04beb8c43" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-14f0e569-0a0e-437d-97d9-3bc04beb8c43" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-69bd80eb-caf0-4e54-bb19-41669387d6ef" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-69bd80eb-caf0-4e54-bb19-41669387d6ef" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Deleting offline snapshot 69bd80eb-caf0-4e54-bb19-41669387d6ef of volume 14f0e569-0a0e-437d-97d9-3bc04beb8c43 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] snapshot_file for this snap is: volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ce12ba-8b85-4781-bb64-86a076bd0ba3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:23 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8 1073741824" returned: 0 in 0.612s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-599e0d29-bc1e-48c2-88ea-8aef5b48cb60-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Lock "cinder-599e0d29-bc1e-48c2-88ea-8aef5b48cb60-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:23 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8 Nov 05 22:36:23 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:23 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef Nov 05 22:36:23 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[415ba13c-9de9-4fab-b72c-2287f7782b5c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:23 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8" returned: 0 in 0.329s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:23 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 Nov 05 22:36:23 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf072120-6b05-41a6-b1f5-8f66d1a5239d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f20da4-f916-4a18-bc24-2f9f421efdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:24 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Volume volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8 (0d3af7c2-cf50-4cce-b350-3698d70fe2d8): created successfully Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f20da4-f916-4a18-bc24-2f9f421efdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Flow 'volume_create_manager' (35abc457-c5d0-4cd3-b140-c1a9b0619aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:24 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2a932385-f8cc-4a1d-9610-aa5911f05204 tempest-CinderUnicodeTest-2088213373 None] Created volume successfully. Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef" returned: 0 in 0.509s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f2427e-9f81-4a3d-9d64-f519ebfa837c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:24 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 Nov 05 22:36:24 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:24 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" returned: 0 in 0.528s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:24 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60 Nov 05 22:36:24 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:24 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43" returned: 0 in 0.511s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:24 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef Nov 05 22:36:24 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:24 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" returned: 0 in 0.322s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-599e0d29-bc1e-48c2-88ea-8aef5b48cb60" released by "delete_volume" :: held 0.947s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Created reservations ['4ecb65d6-b1ea-43fa-a88e-d40d53f343bc', 'b2f9da48-420f-4a1f-b148-d131a024f6d1', '40931352-5133-4c40-96a7-51a439eb2de9', '21840463-c7d0-4bca-95da-6aca7044f5f5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:24 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:24 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:24 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Flow 'volume_create_manager' (2a70372b-96d5-4d26-b31c-45eb4fb6c550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6cdfd7-d4e9-4ed9-be47-642026082a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6cdfd7-d4e9-4ed9-be47-642026082a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-679546860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2d27dd-a508-4835-a850-d4d8b89e5060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f241248349874958bd2c797368278cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:25Z,use_quota=True,user_id='0ad909e8564c4664b76fb0d5525c6a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05123da-bf37-4e3c-adcd-9c17d962c6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05123da-bf37-4e3c-adcd-9c17d962c6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bc7373-501a-4b65-986a-68b1335ea855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bc7373-501a-4b65-986a-68b1335ea855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2d27dd-a508-4835-a850-d4d8b89e5060', 'volume_name': 'volume-3e2d27dd-a508-4835-a850-d4d8b89e5060', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15aa1c2-2cb3-4aa1-9de3-7e9f47fff6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15aa1c2-2cb3-4aa1-9de3-7e9f47fff6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba87218-e662-4b6b-9c1b-0efb3fe28ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Volume 3e2d27dd-a508-4835-a850-d4d8b89e5060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2d27dd-a508-4835-a850-d4d8b89e5060', 'volume_size': 1} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-679546860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2d27dd-a508-4835-a850-d4d8b89e5060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f241248349874958bd2c797368278cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:25Z,use_quota=True,user_id='0ad909e8564c4664b76fb0d5525c6a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Creating volume 3e2d27dd-a508-4835-a850-d4d8b89e5060 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:25 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:25 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 1073741824 Nov 05 22:36:25 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:25 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef" returned: 0 in 0.545s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:25 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef Nov 05 22:36:25 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:25 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.344s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Deleted volume successfully. Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9d7a1c97-ae35-4134-8f75-bdbc1d4e4c9c tempest-ProjectMemberTests-19838403 None] Lock "cinder-599e0d29-bc1e-48c2-88ea-8aef5b48cb60-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:25 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43.69bd80eb-caf0-4e54-bb19-41669387d6ef" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-69bd80eb-caf0-4e54-bb19-41669387d6ef" released by "_delete_snapshot" :: held 1.979s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-14f0e569-0a0e-437d-97d9-3bc04beb8c43" released by "delete_snapshot" :: held 2.010s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Created reservations ['6897be22-0c89-484b-a22a-9a87e8a8ecca', '2fb55055-b14b-4925-9d19-07432dfc3045', 'd2d63e13-82dd-406e-9a4c-ae0f8879e605', '6aeac184-0c40-4578-ada2-b51517d542c3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Delete snapshot completed successfully. Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-4cb8f0e6-30f1-449f-8618-b935ec016619 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-69bd80eb-caf0-4e54-bb19-41669387d6ef-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:25 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 1073741824" returned: 0 in 0.549s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:25 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 Nov 05 22:36:25 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:25 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba87218-e662-4b6b-9c1b-0efb3fe28ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2d27dd-a508-4835-a850-d4d8b89e5060', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730052ed-9281-4c65-bd57-fca428f20443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:25 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Volume volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 (3e2d27dd-a508-4835-a850-d4d8b89e5060): created successfully Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730052ed-9281-4c65-bd57-fca428f20443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:25 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Flow 'volume_create_manager' (2a70372b-96d5-4d26-b31c-45eb4fb6c550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:25 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-fc5fb65e-30e8-44c9-b275-205b5182fc86 tempest-CinderUnicodeTest-2088213373 None] Created volume successfully. Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (8018a2c5-e524-4e9b-8009-efaec736f9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8453985-e33c-4349-9767-6220f1d68520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8453985-e33c-4349-9767-6220f1d68520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743301402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47bbfb7-c609-473d-8f4f-2522c7c1cd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:26Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3803005-a02d-47ab-a96f-77507ec322bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3803005-a02d-47ab-a96f-77507ec322bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b0ece8-2047-4cf8-aa36-c5b171c1495a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b0ece8-2047-4cf8-aa36-c5b171c1495a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f47bbfb7-c609-473d-8f4f-2522c7c1cd14', 'volume_name': 'volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f06a5e-283e-486c-bca8-c4c0b9078c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f06a5e-283e-486c-bca8-c4c0b9078c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9387c56d-a9b8-4299-8210-58db29e8c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:26 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Volume f47bbfb7-c609-473d-8f4f-2522c7c1cd14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14', 'volume_size': 1} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743301402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47bbfb7-c609-473d-8f4f-2522c7c1cd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:26Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Creating volume f47bbfb7-c609-473d-8f4f-2522c7c1cd14 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:26 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:26 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 1073741824 Nov 05 22:36:26 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-14f0e569-0a0e-437d-97d9-3bc04beb8c43-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-14f0e569-0a0e-437d-97d9-3bc04beb8c43-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-14f0e569-0a0e-437d-97d9-3bc04beb8c43" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-14f0e569-0a0e-437d-97d9-3bc04beb8c43" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da975251-4ae3-4dfe-9b04-8295dc4998d1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bbadb9b0-1be0-4ef6-8dc5-3adec06688c0 tempest-ProjectAdminTests-1270959022 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.367332458496, 'free_capacity_gb': 1773.367332458496, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87122) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 22:36:27 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 Nov 05 22:36:27 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:27 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 1073741824" returned: 0 in 0.636s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:27 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 Nov 05 22:36:27 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:27 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43" returned: 0 in 0.531s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:27 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43 Nov 05 22:36:27 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:27 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" returned: 0 in 0.298s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.261s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9387c56d-a9b8-4299-8210-58db29e8c657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9366e8-36b3-4035-bf56-a9b711e3c864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Creating offline snapshot 61fb574a-6b90-405f-be7f-26994eac8253 of volume 3e2d27dd-a508-4835-a850-d4d8b89e5060 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:27 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Volume volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 (f47bbfb7-c609-473d-8f4f-2522c7c1cd14): created successfully Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9366e8-36b3-4035-bf56-a9b711e3c864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (8018a2c5-e524-4e9b-8009-efaec736f9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c305cf2e-5e69-490c-92ab-0c5f79fe3cd4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bb118979-8889-4cff-b504-b4c729b25ee4 tempest-ProjectMemberTests-19838403 None] Created volume successfully. Nov 05 22:36:27 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-14f0e569-0a0e-437d-97d9-3bc04beb8c43" returned: 0 in 0.291s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-14f0e569-0a0e-437d-97d9-3bc04beb8c43" released by "delete_volume" :: held 0.897s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:27 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 Nov 05 22:36:27 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Created reservations ['001b2afc-7a07-4e8a-9a41-d50685974d39', 'b5f66bec-3f7a-4b2a-b5ff-f7a21cde68e5', 'b0406772-2bb5-4569-aad4-5f4e02089c95', 'd1eb00b4-6407-469f-a3d6-f4258d8548af'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:27 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:27 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:28 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:28 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 1G Nov 05 22:36:28 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:28 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.261s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:28 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Deleted volume successfully. Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-240a2a30-458b-4223-93ad-fd9bb2b7d967 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-14f0e569-0a0e-437d-97d9-3bc04beb8c43-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:28 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 1G" returned: 0 in 0.482s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:28 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 Nov 05 22:36:28 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=232,cinder:UPDATE=326,cinder:INSERT=82,cinder:DELETE=32 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:28 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253" returned: 0 in 0.368s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:28 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 is being set with open permissions: ugo+rw Nov 05 22:36:28 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:28 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 Nov 05 22:36:28 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:29 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253" returned: 0 in 0.271s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=229,cinder:UPDATE=299,cinder:DELETE=24,cinder:INSERT=85 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:29 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.info Nov 05 22:36:29 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Flow 'volume_create_manager' (dd4b93e1-7243-4fe0-ac75-9cd34a1968df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a08e8fa-5af4-4c1a-bb54-bb6141024731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a08e8fa-5af4-4c1a-bb54-bb6141024731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704907443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4add4bff-c5b6-480b-bd42-e6d5cb4df7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bb0348fd4a4beca6a6bc1eeabe8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:29Z,use_quota=True,user_id='3afa52ea25444c6784be0469fb2a8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e0afa1-b46b-431f-a3e3-6ec847cd1435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:29 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e0afa1-b46b-431f-a3e3-6ec847cd1435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0e6c53-2e09-430a-b2a7-a2f59d3f251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0e6c53-2e09-430a-b2a7-a2f59d3f251d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4add4bff-c5b6-480b-bd42-e6d5cb4df7ca', 'volume_name': 'volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a6508b-780d-4f76-9482-ca4f1405cda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a6508b-780d-4f76-9482-ca4f1405cda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31567ac0-227f-4383-99ad-0e54366ad1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:29 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Volume 4add4bff-c5b6-480b-bd42-e6d5cb4df7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca', 'volume_size': 1} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.info" returned: 0 in 0.393s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:29 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.info is being set with open permissions: ugo+rw Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:29 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.info Nov 05 22:36:29 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:29 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.info" returned: 0 in 0.265s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.141s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Creating offline snapshot bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 of volume f47bbfb7-c609-473d-8f4f-2522c7c1cd14 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:29 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ea7d6e4d-862e-497e-ab35-ed005552911e tempest-CinderUnicodeTest-2088213373 None] Create snapshot completed successfully Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afdfaff-7fbb-481d-b19d-4ffeac9424ed]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:30 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 Nov 05 22:36:30 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:30 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:30 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 1G Nov 05 22:36:30 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "cinder-61fb574a-6b90-405f-be7f-26994eac8253-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-61fb574a-6b90-405f-be7f-26994eac8253-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "cinder-quobyte-3e2d27dd-a508-4835-a850-d4d8b89e5060" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-quobyte-3e2d27dd-a508-4835-a850-d4d8b89e5060" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "cinder-quobyte-61fb574a-6b90-405f-be7f-26994eac8253" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-quobyte-61fb574a-6b90-405f-be7f-26994eac8253" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Deleting offline snapshot 61fb574a-6b90-405f-be7f-26994eac8253 of volume 3e2d27dd-a508-4835-a850-d4d8b89e5060 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] snapshot_file for this snap is: volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0679876-7ab1-43ea-8de7-3e0489847f5e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:30 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 Nov 05 22:36:30 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:30 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 1G" returned: 0 in 0.521s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:30 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 Nov 05 22:36:30 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:30 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253" returned: 0 in 0.420s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:30 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2d27dd-a508-4835-a850-d4d8b89e5060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82db0263-fd33-465f-9791-6ed8285178c4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:31 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 Nov 05 22:36:31 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:31 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3" returned: 0 in 0.345s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:31 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 is being set with open permissions: ugo+rw Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:31 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 Nov 05 22:36:31 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:31 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3" returned: 0 in 0.246s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:31 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060" returned: 0 in 0.432s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:31 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.info Nov 05 22:36:31 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:31 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 Nov 05 22:36:31 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:31 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.info" returned: 0 in 0.315s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:31 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.info is being set with open permissions: ugo+rw Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:31 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.info Nov 05 22:36:31 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:31 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253" returned: 0 in 0.448s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:31 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253 Nov 05 22:36:31 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:32 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.info" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.471s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704907443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4add4bff-c5b6-480b-bd42-e6d5cb4df7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bb0348fd4a4beca6a6bc1eeabe8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:29Z,use_quota=True,user_id='3afa52ea25444c6784be0469fb2a8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Creating volume 4add4bff-c5b6-480b-bd42-e6d5cb4df7ca {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:32 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:32 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca 1073741824 Nov 05 22:36:32 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-245f34c5-ca55-4f85-9a04-8bedfd1384f1 tempest-ProjectMemberTests-19838403 None] Create snapshot completed successfully Nov 05 22:36:32 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060.61fb574a-6b90-405f-be7f-26994eac8253" returned: 0 in 0.295s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-quobyte-61fb574a-6b90-405f-be7f-26994eac8253" released by "_delete_snapshot" :: held 1.748s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-quobyte-3e2d27dd-a508-4835-a850-d4d8b89e5060" released by "delete_snapshot" :: held 1.774s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Created reservations ['a99a6631-90ed-44cb-a728-0283b3484c3d', '63de9060-8c51-46c6-abf1-197acee66fac', '3771f587-f957-4b16-ac12-e62934256ddd', '7d74518c-ab92-44aa-8fc7-90d72388858d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Delete snapshot completed successfully. Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-9ec40166-2725-4c1b-9a48-be6b42193e6b tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-61fb574a-6b90-405f-be7f-26994eac8253-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:32 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca 1073741824" returned: 0 in 0.520s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "cinder-3e2d27dd-a508-4835-a850-d4d8b89e5060-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:32 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca Nov 05 22:36:32 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-3e2d27dd-a508-4835-a850-d4d8b89e5060-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "cinder-quobyte-3e2d27dd-a508-4835-a850-d4d8b89e5060" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-quobyte-3e2d27dd-a508-4835-a850-d4d8b89e5060" acquired by "delete_volume" :: waited 0.025s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b24578b-3990-4777-a075-7176edfbcdf6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:32 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" returned: 0 in 0.305s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31567ac0-227f-4383-99ad-0e54366ad1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:32 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3ce6b5-b6c0-489c-983e-5706083e6981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:32 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 Nov 05 22:36:32 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:33 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Volume volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca (4add4bff-c5b6-480b-bd42-e6d5cb4df7ca): created successfully Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3ce6b5-b6c0-489c-983e-5706083e6981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Flow 'volume_create_manager' (dd4b93e1-7243-4fe0-ac75-9cd34a1968df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:33 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ea2996fd-5c1f-4442-86be-7d66a39dec3a tempest-ProjectReaderTests-1671521057 None] Created volume successfully. Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Lock "cinder-bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Deleting offline snapshot bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 of volume f47bbfb7-c609-473d-8f4f-2522c7c1cd14 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] snapshot_file for this snap is: volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da73f5a-0991-4fa6-969a-65afcd121d29]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:33 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 Nov 05 22:36:33 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:33 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060" returned: 0 in 0.480s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:33 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060 Nov 05 22:36:33 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:33 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3" returned: 0 in 0.415s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:33 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-3e2d27dd-a508-4835-a850-d4d8b89e5060" returned: 0 in 0.294s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9864baa7-65bc-42f6-bd4b-800baac45b56]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-quobyte-3e2d27dd-a508-4835-a850-d4d8b89e5060" released by "delete_volume" :: held 0.885s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Created reservations ['70c71342-83de-4fed-9b84-9bf5b0b4e70c', 'cf623f73-001b-4f85-bb18-71fa7594ed95', '331249a0-a414-49d7-b0b9-1f149298241e', '4cf17e10-95ab-4c32-9c7f-a667e6e4c99e'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:33 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 Nov 05 22:36:33 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:33 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:33 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "cinder-0d3af7c2-cf50-4cce-b350-3698d70fe2d8-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:33 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-0d3af7c2-cf50-4cce-b350-3698d70fe2d8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "cinder-quobyte-0d3af7c2-cf50-4cce-b350-3698d70fe2d8" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-quobyte-0d3af7c2-cf50-4cce-b350-3698d70fe2d8" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2824a29-156b-4028-ab12-a73db2a1b10f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:34 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" returned: 0 in 0.524s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:34 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 Nov 05 22:36:34 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:34 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:34 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8 Nov 05 22:36:34 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.455s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:34 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Deleted volume successfully. Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Creating offline snapshot c9c3c30a-ad83-403c-ab7e-a81cd65df362 of volume 4add4bff-c5b6-480b-bd42-e6d5cb4df7ca {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-65a0d8ff-20a0-4a73-a620-2926f3d5f0c3 tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-3e2d27dd-a508-4835-a850-d4d8b89e5060-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4612ddc3-9a29-4e9a-abfb-d657251291fd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:34 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca Nov 05 22:36:34 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:34 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8" returned: 0 in 0.475s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:34 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8 Nov 05 22:36:34 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:34 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3" returned: 0 in 0.494s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:34 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3 Nov 05 22:36:34 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:34 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" returned: 0 in 0.479s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:34 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 1G Nov 05 22:36:34 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:34 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0d3af7c2-cf50-4cce-b350-3698d70fe2d8" returned: 0 in 0.316s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-quobyte-0d3af7c2-cf50-4cce-b350-3698d70fe2d8" released by "delete_volume" :: held 0.855s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:34 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Created reservations ['6f33f46b-a87a-4084-8cec-cdecd6971397', '52bc9f7f-3d37-4cb7-8316-5190707c14e7', '2e237bb9-0acd-4b16-aa1b-40df91930ece', '28cfefce-efb6-47be-bc55-2664270d4fe5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:35 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14.bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3" returned: 0 in 0.359s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:35 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:35 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3" released by "_delete_snapshot" :: held 1.946s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" released by "delete_snapshot" :: held 1.985s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Created reservations ['7eaf6ef7-bbc0-4399-8e18-c6664160723a', 'ccce3067-fb5d-463b-aa50-3b8b2ed25fdf', 'ecfcb777-eb3e-48fe-becc-584264b5be88', 'ae1072aa-212b-47e0-8083-db32570f6608'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Delete snapshot completed successfully. Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-0c465c76-4f4f-4e65-a1f6-35c99e8bf177 tempest-ProjectMemberTests-19838403 None] Lock "cinder-bbcbd88d-8f1a-4d6d-abdd-41f9e190eaf3-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:35 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.378s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:35 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Deleted volume successfully. Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-47de1d79-d8b1-46ec-944b-a05191303d32 tempest-CinderUnicodeTest-2088213373 None] Lock "cinder-0d3af7c2-cf50-4cce-b350-3698d70fe2d8-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:35 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 1G" returned: 0 in 0.617s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:35 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 Nov 05 22:36:35 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:35 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362" returned: 0 in 0.348s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:35 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 is being set with open permissions: ugo+rw Nov 05 22:36:35 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:35 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 Nov 05 22:36:35 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:36 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362" returned: 0 in 0.304s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:36 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.info Nov 05 22:36:36 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-f47bbfb7-c609-473d-8f4f-2522c7c1cd14-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Lock "cinder-f47bbfb7-c609-473d-8f4f-2522c7c1cd14-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" acquired by "delete_volume" :: waited 0.033s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:36 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.info" returned: 0 in 0.395s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:36 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.info is being set with open permissions: ugo+rw Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a0d09-3071-406e-a453-4fa16e29b739]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:36 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.info Nov 05 22:36:36 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:36 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 Nov 05 22:36:36 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:36 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.info" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-50e711ca-dde4-4a39-be77-701eecbb5d67 tempest-ProjectReaderTests-1671521057 None] Create snapshot completed successfully Nov 05 22:36:37 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" returned: 0 in 0.517s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:37 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14 Nov 05 22:36:37 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:37 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" returned: 0 in 0.295s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-f47bbfb7-c609-473d-8f4f-2522c7c1cd14" released by "delete_volume" :: held 0.923s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Created reservations ['34679fe4-6157-4b42-a94c-61af734ee304', '097cc89f-d61b-421f-8b9c-cae945f5d7e4', '0a7301e0-7e6e-4194-b920-b7efbd7f4067', '8b870b91-ca44-4588-af66-f319d02531a5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:37 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:37 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-c9c3c30a-ad83-403c-ab7e-a81cd65df362-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-c9c3c30a-ad83-403c-ab7e-a81cd65df362-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-c9c3c30a-ad83-403c-ab7e-a81cd65df362" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-c9c3c30a-ad83-403c-ab7e-a81cd65df362" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Deleting offline snapshot c9c3c30a-ad83-403c-ab7e-a81cd65df362 of volume 4add4bff-c5b6-480b-bd42-e6d5cb4df7ca {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] snapshot_file for this snap is: volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e07fa32-123d-499b-a837-1067b831fb51]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:37 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Deleted volume successfully. Nov 05 22:36:37 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-5ea968f8-0505-46f8-878c-e770e177e44e tempest-ProjectMemberTests-19838403 None] Lock "cinder-f47bbfb7-c609-473d-8f4f-2522c7c1cd14-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:37 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 Nov 05 22:36:37 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:38 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362" returned: 0 in 0.448s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:38 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6255f5-83dc-4677-bf79-06dbf927f104]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:38 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca Nov 05 22:36:38 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:38 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" returned: 0 in 0.529s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:38 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 Nov 05 22:36:38 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (df412aab-3cb8-474e-903e-be26349f0c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e803d8-081c-469b-b535-0ea16552b289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e803d8-081c-469b-b535-0ea16552b289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760495146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827c1c2a-517e-4bb4-a61f-bd390d0f6d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:39Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aae3acf-5f42-4aab-8119-9b21199bc18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aae3acf-5f42-4aab-8119-9b21199bc18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c530516-6e32-49d8-8930-0aadc8066ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c530516-6e32-49d8-8930-0aadc8066ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827c1c2a-517e-4bb4-a61f-bd390d0f6d80', 'volume_name': 'volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387c2a18-ba19-41f8-9582-b12c5c626301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387c2a18-ba19-41f8-9582-b12c5c626301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122433bf-b137-4643-96fc-801feeb0abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Volume 827c1c2a-517e-4bb4-a61f-bd390d0f6d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80', 'volume_size': 1} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760495146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827c1c2a-517e-4bb4-a61f-bd390d0f6d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:39Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Creating volume 827c1c2a-517e-4bb4-a61f-bd390d0f6d80 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:39 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:39 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 1073741824 Nov 05 22:36:39 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:39 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362" returned: 0 in 0.530s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:39 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362 Nov 05 22:36:39 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:39 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca.c9c3c30a-ad83-403c-ab7e-a81cd65df362" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-c9c3c30a-ad83-403c-ab7e-a81cd65df362" released by "_delete_snapshot" :: held 1.953s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" released by "delete_snapshot" :: held 2.000s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Created reservations ['33d24455-e943-494c-aeb5-c13de1eef00b', '346b67de-fc63-4d54-888d-af65c9c13e98', 'e7f0057b-50bd-4c41-9272-b9acecbc8c4b', 'fd983077-4094-4ccb-b2ab-09eba3e2c4b5'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Delete snapshot completed successfully. Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-587df8ea-2a95-42a4-885f-85c88fe4ca25 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-c9c3c30a-ad83-403c-ab7e-a81cd65df362-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:39 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 1073741824" returned: 0 in 0.684s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:40 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 Nov 05 22:36:40 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:40 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:40 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122433bf-b137-4643-96fc-801feeb0abbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c5f3fc-65c0-425d-ba60-151145f2bb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Volume volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 (827c1c2a-517e-4bb4-a61f-bd390d0f6d80): created successfully Nov 05 22:36:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c5f3fc-65c0-425d-ba60-151145f2bb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (df412aab-3cb8-474e-903e-be26349f0c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-93f0524b-1c1d-4d3d-aca2-4240fd89105e tempest-ProjectMemberTests-19838403 None] Created volume successfully. Nov 05 22:36:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c4f07a-57a0-4cbf-9277-354743b5150a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:41 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca Nov 05 22:36:41 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Creating offline snapshot e1146f2f-8643-4597-a630-0f9e159ee821 of volume 827c1c2a-517e-4bb4-a61f-bd390d0f6d80 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabc1ff1-a90f-4bce-ab49-3a54fd0b5647]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:41 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" returned: 0 in 0.469s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:41 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca Nov 05 22:36:41 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:41 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 Nov 05 22:36:41 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:41 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" returned: 0 in 0.336s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca" released by "delete_volume" :: held 0.891s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:41 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Created reservations ['e70f2683-a8bb-4e2e-b576-f28d97eb4ca4', '7755cd3b-8c88-47e9-b76f-8b36fa95dc8a', '258f62e2-3a79-4e76-b92b-5b7c961d0440', 'bb7a38aa-7893-470a-8fac-eb67820e9b1c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:42 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" returned: 0 in 0.539s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:42 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 1G Nov 05 22:36:42 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:42 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:42 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:42 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Deleted volume successfully. Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6266b310-ad79-488f-8995-49f66f666f39 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-4add4bff-c5b6-480b-bd42-e6d5cb4df7ca-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:42 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 1G" returned: 0 in 0.560s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:42 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 Nov 05 22:36:42 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:42 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821" returned: 0 in 0.301s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:42 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 is being set with open permissions: ugo+rw Nov 05 22:36:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:42 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 Nov 05 22:36:42 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:43 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821" returned: 0 in 0.264s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:43 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.info Nov 05 22:36:43 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:43 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.info" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:43 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.info is being set with open permissions: ugo+rw Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:43 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.info Nov 05 22:36:43 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Flow 'volume_create_manager' (cad4398d-4472-4b3e-8c0c-7fea8fa194b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd183d80-5161-4af3-929b-6ac980a2e38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd183d80-5161-4af3-929b-6ac980a2e38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955150671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7adaac-246d-4acf-85dc-ea160131f125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bb0348fd4a4beca6a6bc1eeabe8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:44Z,use_quota=True,user_id='3afa52ea25444c6784be0469fb2a8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b9c7d3-1b9d-4f67-94fa-4af23831febf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b9c7d3-1b9d-4f67-94fa-4af23831febf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5088e5a-bd3d-419c-927b-808b37b9b592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5088e5a-bd3d-419c-927b-808b37b9b592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7adaac-246d-4acf-85dc-ea160131f125', 'volume_name': 'volume-7a7adaac-246d-4acf-85dc-ea160131f125', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b760dd68-562e-4370-a8be-fb6d7d41e9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b760dd68-562e-4370-a8be-fb6d7d41e9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcf387e-9df1-4523-8fba-05d36ec80c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:43 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Volume 7a7adaac-246d-4acf-85dc-ea160131f125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7adaac-246d-4acf-85dc-ea160131f125', 'volume_size': 1} Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:43 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.info" returned: 0 in 0.352s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.523s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955150671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7adaac-246d-4acf-85dc-ea160131f125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bb0348fd4a4beca6a6bc1eeabe8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:44Z,use_quota=True,user_id='3afa52ea25444c6784be0469fb2a8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Creating volume 7a7adaac-246d-4acf-85dc-ea160131f125 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:44 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-db60aa6f-4b8a-4c9e-aed7-5ac17621e8eb tempest-ProjectMemberTests-19838403 None] Create snapshot completed successfully Nov 05 22:36:44 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 1073741824 Nov 05 22:36:44 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:44 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 1073741824" returned: 0 in 0.522s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:44 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 Nov 05 22:36:44 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-e1146f2f-8643-4597-a630-0f9e159ee821-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-e1146f2f-8643-4597-a630-0f9e159ee821-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-e1146f2f-8643-4597-a630-0f9e159ee821" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-e1146f2f-8643-4597-a630-0f9e159ee821" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Deleting offline snapshot e1146f2f-8643-4597-a630-0f9e159ee821 of volume 827c1c2a-517e-4bb4-a61f-bd390d0f6d80 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] snapshot_file for this snap is: volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff4b82a-e29e-411e-b5d3-bb10a11114b4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:44 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125" returned: 0 in 0.365s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fcf387e-9df1-4523-8fba-05d36ec80c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7adaac-246d-4acf-85dc-ea160131f125', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:44 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 Nov 05 22:36:44 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:44 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b249ba-0b66-48fd-a68c-ac66c07ea331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:44 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Volume volume-7a7adaac-246d-4acf-85dc-ea160131f125 (7a7adaac-246d-4acf-85dc-ea160131f125): created successfully Nov 05 22:36:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b249ba-0b66-48fd-a68c-ac66c07ea331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:45 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Flow 'volume_create_manager' (cad4398d-4472-4b3e-8c0c-7fea8fa194b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:45 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4e82d61d-867b-425c-99a2-54663d722443 tempest-ProjectReaderTests-1671521057 None] Created volume successfully. Nov 05 22:36:45 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821" returned: 0 in 0.391s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:45 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:45 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfa6d57-39ad-4e10-868d-302ade32231f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:45 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 Nov 05 22:36:45 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:45 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" returned: 0 in 0.448s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:45 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:45 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 Nov 05 22:36:45 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Creating offline snapshot e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 of volume 7a7adaac-246d-4acf-85dc-ea160131f125 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[096e9b25-d74e-4bb0-bc88-2a77b313796d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:46 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821" returned: 0 in 0.481s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:46 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821 Nov 05 22:36:46 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:46 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 Nov 05 22:36:46 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:46 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80.e1146f2f-8643-4597-a630-0f9e159ee821" returned: 0 in 0.324s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-e1146f2f-8643-4597-a630-0f9e159ee821" released by "_delete_snapshot" :: held 1.800s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" released by "delete_snapshot" :: held 1.834s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:46 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125" returned: 0 in 0.425s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:46 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 1G Nov 05 22:36:46 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Created reservations ['de07dc53-3a80-4e61-b582-85e435dbfbee', '0b1f97bb-5d1a-4452-afa4-f2b942f3e18c', '9f1f8a61-ea6b-49c2-bd53-5528e4417c65', 'a7c590c8-b705-4369-a7bf-c1e6278fe817'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:46 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Delete snapshot completed successfully. Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-c7e00648-5734-492d-a57a-dfe3d1a26bd3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-e1146f2f-8643-4597-a630-0f9e159ee821-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-827c1c2a-517e-4bb4-a61f-bd390d0f6d80-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:46 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Lock "cinder-827c1c2a-517e-4bb4-a61f-bd390d0f6d80-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d292d-8d16-4581-98ef-6d8e25f8373a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:47 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 1G" returned: 0 in 0.640s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7adaac-246d-4acf-85dc-ea160131f125 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:47 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 Nov 05 22:36:47 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:47 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7adaac-246d-4acf-85dc-ea160131f125 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 Nov 05 22:36:47 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:47 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" returned: 0 in 0.491s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:47 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80 Nov 05 22:36:47 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:47 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7adaac-246d-4acf-85dc-ea160131f125 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5" returned: 0 in 0.426s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:47 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 is being set with open permissions: ugo+rw Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:47 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 Nov 05 22:36:47 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:47 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" returned: 0 in 0.364s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:47 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-827c1c2a-517e-4bb4-a61f-bd390d0f6d80" released by "delete_volume" :: held 0.952s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Created reservations ['d0eb3564-5a84-4240-b9c5-4f61701a7eb2', '6bae2e73-c10f-445e-b039-e9e31e7f3585', 'ebd13f83-ee4b-48cb-a8cf-1e8c9ba717a6', 'e814fc42-75a9-4353-adc7-ee82c3106ec3'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:48 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5" returned: 0 in 0.427s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:48 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.info Nov 05 22:36:48 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:48 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:48 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:48 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.info" returned: 0 in 0.348s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:48 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.info is being set with open permissions: ugo+rw Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:48 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.info Nov 05 22:36:48 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:48 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.305s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Deleted volume successfully. Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-064a8ba7-e8d7-4a52-9b9f-a7e5c6ab5083 tempest-ProjectMemberTests-19838403 None] Lock "cinder-827c1c2a-517e-4bb4-a61f-bd390d0f6d80-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:48 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.info" returned: 0 in 0.272s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:48 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:48 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1fe4a8a8-b36a-4067-bc82-53bd880cde7f tempest-ProjectReaderTests-1671521057 None] Create snapshot completed successfully Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-e6cbf216-e32a-4d2d-bbad-6ede5463d2a5-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Lock "cinder-e6cbf216-e32a-4d2d-bbad-6ede5463d2a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-7a7adaac-246d-4acf-85dc-ea160131f125" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-7a7adaac-246d-4acf-85dc-ea160131f125" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-e6cbf216-e32a-4d2d-bbad-6ede5463d2a5" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-e6cbf216-e32a-4d2d-bbad-6ede5463d2a5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Deleting offline snapshot e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 of volume 7a7adaac-246d-4acf-85dc-ea160131f125 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] snapshot_file for this snap is: volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f733b6-49fb-4744-a91f-1835f72f801f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:49 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 Nov 05 22:36:49 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (7b626568-fcca-4361-bc61-363c48af0381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c1a006-dfc9-4492-9a26-584ef9fde0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c1a006-dfc9-4492-9a26-584ef9fde0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071921930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8917d0d-6217-4ef5-8803-ea6f029b5c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:50Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235e21b2-d6c3-46d4-954f-1b2e72d622fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235e21b2-d6c3-46d4-954f-1b2e72d622fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f552c35-e001-4f31-ac43-7e80628ade82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f552c35-e001-4f31-ac43-7e80628ade82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8917d0d-6217-4ef5-8803-ea6f029b5c97', 'volume_name': 'volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a156324f-f84f-4ecc-a523-5fff979c36d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a156324f-f84f-4ecc-a523-5fff979c36d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a19b9a-1c2b-4f02-8263-201d7581e079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:49 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Volume b8917d0d-6217-4ef5-8803-ea6f029b5c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97', 'volume_size': 1} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071921930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8917d0d-6217-4ef5-8803-ea6f029b5c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:50Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Creating volume b8917d0d-6217-4ef5-8803-ea6f029b5c97 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:50 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:50 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5" returned: 0 in 0.549s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a7adaac-246d-4acf-85dc-ea160131f125(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:50 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 1073741824 Nov 05 22:36:50 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[681e945f-a8d6-4dad-a595-a41ebd1efdef]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:50 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 Nov 05 22:36:50 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:50 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125" returned: 0 in 0.466s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:50 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 Nov 05 22:36:50 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:50 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 1073741824" returned: 0 in 0.636s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:50 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 Nov 05 22:36:50 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:51 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97" returned: 0 in 0.333s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a19b9a-1c2b-4f02-8263-201d7581e079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0918aae3-0344-4110-a7ff-31f250a5fcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:51 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5" returned: 0 in 0.542s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:51 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Volume volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 (b8917d0d-6217-4ef5-8803-ea6f029b5c97): created successfully Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0918aae3-0344-4110-a7ff-31f250a5fcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:51 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5 Nov 05 22:36:51 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (7b626568-fcca-4361-bc61-363c48af0381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-69b52f5c-205e-47db-955d-2f0fce005296 tempest-ProjectMemberTests-19838403 None] Created volume successfully. Nov 05 22:36:51 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125.e6cbf216-e32a-4d2d-bbad-6ede5463d2a5" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-e6cbf216-e32a-4d2d-bbad-6ede5463d2a5" released by "_delete_snapshot" :: held 1.953s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-7a7adaac-246d-4acf-85dc-ea160131f125" released by "delete_snapshot" :: held 1.982s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Created reservations ['de9ee7a2-d861-461e-9f5f-a2b8b58dcc52', '14e1f3fd-90cd-49b9-8063-904f0a52aade', '366a40eb-bc9b-4948-b063-b11e13b0690e', '68d1ad7e-b22c-4a18-a93d-98de6fd752ae'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Delete snapshot completed successfully. Nov 05 22:36:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-85bd9240-eb61-4f13-81c0-8c12e9ecea3b tempest-ProjectReaderTests-1671521057 None] Lock "cinder-e6cbf216-e32a-4d2d-bbad-6ede5463d2a5-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Creating offline snapshot 1fb6b748-5a5b-4650-8674-fba0ed56a812 of volume b8917d0d-6217-4ef5-8803-ea6f029b5c97 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1db3e97-700e-4df5-bc50-360d52c79670]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:52 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 Nov 05 22:36:52 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:52 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97" returned: 0 in 0.380s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:52 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 1G Nov 05 22:36:52 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-7a7adaac-246d-4acf-85dc-ea160131f125-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-7a7adaac-246d-4acf-85dc-ea160131f125-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-7a7adaac-246d-4acf-85dc-ea160131f125" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-7a7adaac-246d-4acf-85dc-ea160131f125" acquired by "delete_volume" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc54505-1aa5-47cd-87a7-7b2126ab0a65]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:52 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 Nov 05 22:36:52 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:52 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 1G" returned: 0 in 0.526s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:53 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 Nov 05 22:36:53 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:53 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:53 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125 Nov 05 22:36:53 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:53 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812" returned: 0 in 0.308s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:53 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 is being set with open permissions: ugo+rw Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:53 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 Nov 05 22:36:53 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:53 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7a7adaac-246d-4acf-85dc-ea160131f125" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-7a7adaac-246d-4acf-85dc-ea160131f125" released by "delete_volume" :: held 0.758s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Created reservations ['391781a0-bbca-4729-aaec-019ae7081208', 'b0a591df-996e-4aff-8938-7b1ccbbcb704', '2b17614d-4de0-496e-bb92-c08af993d2f5', '3614dd7f-3154-4f0e-84cb-c053967798a2'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:53 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:53 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:53 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:53 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.info Nov 05 22:36:53 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:53 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Deleted volume successfully. Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-de0a354c-03c8-42b5-83cb-c8694cbf9171 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-7a7adaac-246d-4acf-85dc-ea160131f125-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:53 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.info" returned: 0 in 0.283s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:53 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.info is being set with open permissions: ugo+rw Nov 05 22:36:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:53 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.info Nov 05 22:36:53 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:54 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.info" returned: 0 in 0.289s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-9b6efbd4-6a32-418f-b3fc-7b35ff29246a tempest-ProjectMemberTests-19838403 None] Create snapshot completed successfully Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Flow 'volume_create_manager' (0b77e32b-8c92-4ac9-9e17-46d64a84e7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d2edad-6dc0-44eb-8311-f79a25fb22ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d2edad-6dc0-44eb-8311-f79a25fb22ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2083171372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83f5a2f-696c-4e07-80e1-5550c56ec69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bb0348fd4a4beca6a6bc1eeabe8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:54Z,use_quota=True,user_id='3afa52ea25444c6784be0469fb2a8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8325d4-44c2-4166-84dc-ba761208041e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8325d4-44c2-4166-84dc-ba761208041e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5ef7d0-9232-42cd-859a-9e4f052d8c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5ef7d0-9232-42cd-859a-9e4f052d8c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83f5a2f-696c-4e07-80e1-5550c56ec69e', 'volume_name': 'volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b920d340-4bf6-474a-8cf7-2af6dd09b696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b920d340-4bf6-474a-8cf7-2af6dd09b696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a15290-ddcd-4d63-b9e9-75542bf6a65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Volume d83f5a2f-696c-4e07-80e1-5550c56ec69e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e', 'volume_size': 1} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2083171372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83f5a2f-696c-4e07-80e1-5550c56ec69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bb0348fd4a4beca6a6bc1eeabe8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:54Z,use_quota=True,user_id='3afa52ea25444c6784be0469fb2a8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Creating volume d83f5a2f-696c-4e07-80e1-5550c56ec69e {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:54 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:54 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e 1073741824 Nov 05 22:36:54 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:54 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e 1073741824" returned: 0 in 0.473s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:54 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e Nov 05 22:36:54 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:55 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e" returned: 0 in 0.264s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a15290-ddcd-4d63-b9e9-75542bf6a65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9d954c-a7d9-4b37-9e77-63ed903d1d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:55 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Volume volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e (d83f5a2f-696c-4e07-80e1-5550c56ec69e): created successfully Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9d954c-a7d9-4b37-9e77-63ed903d1d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Flow 'volume_create_manager' (0b77e32b-8c92-4ac9-9e17-46d64a84e7e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-4e85d328-2c62-41e7-8d25-32509eab9661 tempest-ProjectReaderTests-1671521057 None] Created volume successfully. Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-1fb6b748-5a5b-4650-8674-fba0ed56a812-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Lock "cinder-1fb6b748-5a5b-4650-8674-fba0ed56a812-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-b8917d0d-6217-4ef5-8803-ea6f029b5c97" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-b8917d0d-6217-4ef5-8803-ea6f029b5c97" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-1fb6b748-5a5b-4650-8674-fba0ed56a812" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-1fb6b748-5a5b-4650-8674-fba0ed56a812" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Deleting offline snapshot 1fb6b748-5a5b-4650-8674-fba0ed56a812 of volume b8917d0d-6217-4ef5-8803-ea6f029b5c97 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] snapshot_file for this snap is: volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[157b3589-092f-4524-a9fc-2ce087d0bacc]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:55 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 Nov 05 22:36:55 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:55 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812" returned: 0 in 0.391s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bd5a1c-d9d8-4787-b7e7-a6f3218a56c0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:55 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 Nov 05 22:36:55 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:56 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97" returned: 0 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:56 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 Nov 05 22:36:56 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Creating offline snapshot cdd4fc08-211e-4396-8e7e-7304103e7904 of volume d83f5a2f-696c-4e07-80e1-5550c56ec69e {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5ea28e-3ce2-434d-ac76-9b1964fe7130]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:56 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812" returned: 0 in 0.409s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:56 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812 Nov 05 22:36:56 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:56 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e Nov 05 22:36:56 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:56 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97.1fb6b748-5a5b-4650-8674-fba0ed56a812" returned: 0 in 0.259s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-1fb6b748-5a5b-4650-8674-fba0ed56a812" released by "_delete_snapshot" :: held 1.559s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-b8917d0d-6217-4ef5-8803-ea6f029b5c97" released by "delete_snapshot" :: held 1.582s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:56 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e" returned: 0 in 0.379s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:56 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 1G Nov 05 22:36:56 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:56 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Created reservations ['9033f147-9e3b-4b52-862e-68835ecba57c', 'f94bc649-a664-4184-8641-2ffdaf97c7bb', 'd8650326-b508-41ed-9fd4-df1362a54f5d', '38b53715-bc3f-4dc1-b071-e31dcad92f75'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:57 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Delete snapshot completed successfully. Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2784795a-6b6b-41be-ae3d-8e7c678d8534 tempest-ProjectMemberTests-19838403 None] Lock "cinder-1fb6b748-5a5b-4650-8674-fba0ed56a812-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:57 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 1G" returned: 0 in 0.400s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:57 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 Nov 05 22:36:57 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-b8917d0d-6217-4ef5-8803-ea6f029b5c97-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Lock "cinder-b8917d0d-6217-4ef5-8803-ea6f029b5c97-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-b8917d0d-6217-4ef5-8803-ea6f029b5c97" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-b8917d0d-6217-4ef5-8803-ea6f029b5c97" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5287e5d0-767a-4181-9d12-902a64b11bc9]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:57 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904" returned: 0 in 0.307s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:57 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 is being set with open permissions: ugo+rw Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:57 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 Nov 05 22:36:57 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:57 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 Nov 05 22:36:57 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:57 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:57 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:57 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:57 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.269s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:36:57 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.info Nov 05 22:36:57 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:57 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97" returned: 0 in 0.392s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:57 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97 Nov 05 22:36:57 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:58 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.info" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:58 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.info is being set with open permissions: ugo+rw Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:58 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b8917d0d-6217-4ef5-8803-ea6f029b5c97" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:58 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.info Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-b8917d0d-6217-4ef5-8803-ea6f029b5c97" released by "delete_volume" :: held 0.701s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:58 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Created reservations ['b59b942e-b34d-4a02-a765-f2e586486ac6', 'b71e8f83-d815-4f24-9374-edcb3f8e0035', 'bca12c21-c902-42ac-8c21-4c77a8433fa3', '36e3827b-163a-49e2-badc-ddd40c954ca0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:58 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:36:58 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:58 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.info" returned: 0 in 0.245s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d0cd7037-7cda-468a-b0b3-3790e8593368 tempest-ProjectReaderTests-1671521057 None] Create snapshot completed successfully Nov 05 22:36:58 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.264s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:36:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Deleted volume successfully. Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-ac4fd5a3-cfc0-4c7a-b1a6-8138d07ee7d2 tempest-ProjectMemberTests-19838403 None] Lock "cinder-b8917d0d-6217-4ef5-8803-ea6f029b5c97-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-cdd4fc08-211e-4396-8e7e-7304103e7904-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-cdd4fc08-211e-4396-8e7e-7304103e7904-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-d83f5a2f-696c-4e07-80e1-5550c56ec69e" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-d83f5a2f-696c-4e07-80e1-5550c56ec69e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-cdd4fc08-211e-4396-8e7e-7304103e7904" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-cdd4fc08-211e-4396-8e7e-7304103e7904" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Deleting offline snapshot cdd4fc08-211e-4396-8e7e-7304103e7904 of volume d83f5a2f-696c-4e07-80e1-5550c56ec69e {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] snapshot_file for this snap is: volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dfec11-1973-4283-9a63-ae55a6090d1e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:58 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 Nov 05 22:36:58 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (2e0769a4-0890-48c4-b52a-883f95d38692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3e9d7c-3c31-4098-8eec-722a4929387c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:59 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3e9d7c-3c31-4098-8eec-722a4929387c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858285242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769d9faa-4547-48e1-8fcf-68c534932ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:59Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0c0993-795b-4065-a5a9-2ac8928952ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d0c0993-795b-4065-a5a9-2ac8928952ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02092d44-1462-44d5-95aa-9017fc689a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02092d44-1462-44d5-95aa-9017fc689a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769d9faa-4547-48e1-8fcf-68c534932ae6', 'volume_name': 'volume-769d9faa-4547-48e1-8fcf-68c534932ae6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86001a88-0927-4d43-a30d-8a1673ba86da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86001a88-0927-4d43-a30d-8a1673ba86da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091871db-09b5-4227-aa15-28b23c427d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Volume 769d9faa-4547-48e1-8fcf-68c534932ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769d9faa-4547-48e1-8fcf-68c534932ae6', 'volume_size': 1} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858285242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769d9faa-4547-48e1-8fcf-68c534932ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:36:59Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Creating volume 769d9faa-4547-48e1-8fcf-68c534932ae6 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:36:59 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904" returned: 0 in 0.458s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:36:59 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 1073741824 Nov 05 22:36:59 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d010f0bb-aedc-4bfd-ab36-f6e8e110b22d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:59 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e Nov 05 22:36:59 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:59 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 1073741824" returned: 0 in 0.403s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:59 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:36:59 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 Nov 05 22:36:59 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:59 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 Nov 05 22:36:59 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:36:59 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091871db-09b5-4227-aa15-28b23c427d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769d9faa-4547-48e1-8fcf-68c534932ae6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77be3c3-cbd6-4a82-8619-ee465e292050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:36:59 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Volume volume-769d9faa-4547-48e1-8fcf-68c534932ae6 (769d9faa-4547-48e1-8fcf-68c534932ae6): created successfully Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77be3c3-cbd6-4a82-8619-ee465e292050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (2e0769a4-0890-48c4-b52a-883f95d38692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:36:59 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7238861e-c0a5-442f-a8ae-651ee4a540f8 tempest-ProjectMemberTests-19838403 None] Created volume successfully. Nov 05 22:36:59 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904" returned: 0 in 0.355s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:36:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:00 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904 Nov 05 22:37:00 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:00 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e.cdd4fc08-211e-4396-8e7e-7304103e7904" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-cdd4fc08-211e-4396-8e7e-7304103e7904" released by "_delete_snapshot" :: held 1.577s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-d83f5a2f-696c-4e07-80e1-5550c56ec69e" released by "delete_snapshot" :: held 1.609s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Creating offline snapshot d43d0bd5-07f4-41cf-ad0d-4846d3dde524 of volume 769d9faa-4547-48e1-8fcf-68c534932ae6 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcff1247-eb78-491b-b852-d6d5e9a1b04b]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Created reservations ['b1472672-e2c4-4424-aa32-e970def29c0e', '2147bb07-515a-4595-bfb1-c93ba10b2bc9', 'a229d774-986a-4f42-8fac-d950241dc618', 'dfeaac53-5843-4817-a61b-8dfdf9f25f44'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Delete snapshot completed successfully. Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-7d8a821c-7614-4872-866d-339467901f97 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-cdd4fc08-211e-4396-8e7e-7304103e7904-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:00 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 Nov 05 22:37:00 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:00 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6" returned: 0 in 0.366s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:00 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 1G Nov 05 22:37:00 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-d83f5a2f-696c-4e07-80e1-5550c56ec69e-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-d83f5a2f-696c-4e07-80e1-5550c56ec69e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-d83f5a2f-696c-4e07-80e1-5550c56ec69e" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-d83f5a2f-696c-4e07-80e1-5550c56ec69e" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde8a6b9-fdfd-4b01-b5ee-2cf7848e2919]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:01 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e Nov 05 22:37:01 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:01 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 1G" returned: 0 in 0.421s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-769d9faa-4547-48e1-8fcf-68c534932ae6 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:01 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-769d9faa-4547-48e1-8fcf-68c534932ae6 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 Nov 05 22:37:01 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:01 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e" returned: 0 in 0.376s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:01 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e Nov 05 22:37:01 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:01 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-769d9faa-4547-48e1-8fcf-68c534932ae6 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524" returned: 0 in 0.308s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:01 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 is being set with open permissions: ugo+rw Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:01 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 Nov 05 22:37:01 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:01 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d83f5a2f-696c-4e07-80e1-5550c56ec69e" returned: 0 in 0.248s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-d83f5a2f-696c-4e07-80e1-5550c56ec69e" released by "delete_volume" :: held 0.692s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Created reservations ['1834d0b4-b1f9-4963-ba7e-2d55487e6589', 'f940be84-47bf-4748-82db-f1b6046e7314', '1c876b17-ccc8-4a75-a7dd-5743096efc42', '61639438-2473-47f8-8cc3-93395773f87a'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:01 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:01 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.info Nov 05 22:37:01 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:01 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:01 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:01 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.info" returned: 0 in 0.267s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:01 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.info is being set with open permissions: ugo+rw Nov 05 22:37:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:02 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.259s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:02 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.info Nov 05 22:37:02 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Deleted volume successfully. Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-eee51034-af96-4de4-a30e-adebe567e741 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-d83f5a2f-696c-4e07-80e1-5550c56ec69e-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:02 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.info" returned: 0 in 0.277s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-d5198d24-1e6c-4ede-addb-a9d896015f14 tempest-ProjectMemberTests-19838403 None] Create snapshot completed successfully Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Flow 'volume_create_manager' (2594242c-96e3-40ac-bc82-fb3c766cae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f4298b-857a-4beb-8e73-e1134d6d4ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f4298b-857a-4beb-8e73-e1134d6d4ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810402276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ed9981-6ebd-4368-afdc-80125fa14892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bb0348fd4a4beca6a6bc1eeabe8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:02Z,use_quota=True,user_id='3afa52ea25444c6784be0469fb2a8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc4f5e4-1e6a-4df0-9eb6-78f1cb633c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc4f5e4-1e6a-4df0-9eb6-78f1cb633c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce572d1-356e-4f4c-ad67-271928fcfd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce572d1-356e-4f4c-ad67-271928fcfd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ed9981-6ebd-4368-afdc-80125fa14892', 'volume_name': 'volume-d5ed9981-6ebd-4368-afdc-80125fa14892', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2345151-8d4a-4965-a30c-5ffe529298c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2345151-8d4a-4965-a30c-5ffe529298c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0a1703-5b6e-457f-b5a7-febd6a06ce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Volume d5ed9981-6ebd-4368-afdc-80125fa14892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ed9981-6ebd-4368-afdc-80125fa14892', 'volume_size': 1} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810402276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ed9981-6ebd-4368-afdc-80125fa14892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bb0348fd4a4beca6a6bc1eeabe8ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:02Z,use_quota=True,user_id='3afa52ea25444c6784be0469fb2a8004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Creating volume d5ed9981-6ebd-4368-afdc-80125fa14892 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:02 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:37:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:02 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 1073741824 Nov 05 22:37:02 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:02 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 1073741824" returned: 0 in 0.420s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:03 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 Nov 05 22:37:03 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:03 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892" returned: 0 in 0.241s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0a1703-5b6e-457f-b5a7-febd6a06ce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ed9981-6ebd-4368-afdc-80125fa14892', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da498cf-79d2-44a6-9638-19f43fde30c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:03 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Volume volume-d5ed9981-6ebd-4368-afdc-80125fa14892 (d5ed9981-6ebd-4368-afdc-80125fa14892): created successfully Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da498cf-79d2-44a6-9638-19f43fde30c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Flow 'volume_create_manager' (2594242c-96e3-40ac-bc82-fb3c766cae38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-512c67dd-b446-4ce2-9b2e-392b6f1647e9 tempest-ProjectReaderTests-1671521057 None] Created volume successfully. Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-d43d0bd5-07f4-41cf-ad0d-4846d3dde524-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Lock "cinder-d43d0bd5-07f4-41cf-ad0d-4846d3dde524-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-769d9faa-4547-48e1-8fcf-68c534932ae6" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-769d9faa-4547-48e1-8fcf-68c534932ae6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-d43d0bd5-07f4-41cf-ad0d-4846d3dde524" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-d43d0bd5-07f4-41cf-ad0d-4846d3dde524" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Deleting offline snapshot d43d0bd5-07f4-41cf-ad0d-4846d3dde524 of volume 769d9faa-4547-48e1-8fcf-68c534932ae6 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] snapshot_file for this snap is: volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d9678e-f666-43ef-8a18-7d3fffb62cd7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:03 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 Nov 05 22:37:03 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Creating offline snapshot 7ded7e16-103f-4b79-be9f-b15d9f5a4f7c of volume d5ed9981-6ebd-4368-afdc-80125fa14892 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c277d2-d183-4540-959c-f794b7cbf0f1]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:03 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 Nov 05 22:37:03 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:03 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524" returned: 0 in 0.390s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-769d9faa-4547-48e1-8fcf-68c534932ae6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa86dbf1-00ed-4fd4-915b-d8e2756c8004]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:04 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892" returned: 0 in 0.376s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:04 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 Nov 05 22:37:04 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:04 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c 1G Nov 05 22:37:04 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:04 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:04 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 Nov 05 22:37:04 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:04 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c 1G" returned: 0 in 0.408s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ed9981-6ebd-4368-afdc-80125fa14892 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:04 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ed9981-6ebd-4368-afdc-80125fa14892 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c Nov 05 22:37:04 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:04 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524" returned: 0 in 0.349s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:04 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524 Nov 05 22:37:04 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:04 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5ed9981-6ebd-4368-afdc-80125fa14892 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:04 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c is being set with open permissions: ugo+rw Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:04 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c Nov 05 22:37:04 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:04 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6.d43d0bd5-07f4-41cf-ad0d-4846d3dde524" returned: 0 in 0.255s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-d43d0bd5-07f4-41cf-ad0d-4846d3dde524" released by "_delete_snapshot" :: held 1.470s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:04 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-769d9faa-4547-48e1-8fcf-68c534932ae6" released by "delete_snapshot" :: held 1.500s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Created reservations ['1a7a2066-0779-4943-8516-0b97639d86a9', '6ceb0ac8-bfb0-4ee3-82c7-7d1b4ae18586', 'b0e877f7-d0b0-4a44-bbc6-8e640b441d9e', '6afef994-9d00-4cdc-bf86-f7890681630d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:05 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c" returned: 0 in 0.272s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Delete snapshot completed successfully. Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bcf023fa-da04-4e0c-91fc-9d8708298f2b tempest-ProjectMemberTests-19838403 None] Lock "cinder-d43d0bd5-07f4-41cf-ad0d-4846d3dde524-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:05 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.info Nov 05 22:37:05 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:05 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.info" returned: 0 in 0.249s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:05 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.info is being set with open permissions: ugo+rw Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:05 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.info Nov 05 22:37:05 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:05 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.info" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-769d9faa-4547-48e1-8fcf-68c534932ae6-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Lock "cinder-769d9faa-4547-48e1-8fcf-68c534932ae6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:05 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-cd4f0b40-b534-496d-90f6-0a288c35a07d tempest-ProjectReaderTests-1671521057 None] Create snapshot completed successfully Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-769d9faa-4547-48e1-8fcf-68c534932ae6" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-769d9faa-4547-48e1-8fcf-68c534932ae6" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d730bcd9-3c80-4df4-8587-bca936ccb5cd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-7ded7e16-103f-4b79-be9f-b15d9f5a4f7c-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-7ded7e16-103f-4b79-be9f-b15d9f5a4f7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-d5ed9981-6ebd-4368-afdc-80125fa14892" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-d5ed9981-6ebd-4368-afdc-80125fa14892" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-7ded7e16-103f-4b79-be9f-b15d9f5a4f7c" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-7ded7e16-103f-4b79-be9f-b15d9f5a4f7c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Deleting offline snapshot 7ded7e16-103f-4b79-be9f-b15d9f5a4f7c of volume d5ed9981-6ebd-4368-afdc-80125fa14892 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] snapshot_file for this snap is: volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8d5b6e-d6b4-4ce0-b4a3-95c43b31102a]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:05 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:05 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 Nov 05 22:37:05 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:05 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c Nov 05 22:37:05 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:06 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:06 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6 Nov 05 22:37:06 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:06 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c" returned: 0 in 0.374s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5ed9981-6ebd-4368-afdc-80125fa14892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[25002b52-aab2-4094-b65e-ef9bf018a5d0]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:06 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 Nov 05 22:37:06 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:06 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-769d9faa-4547-48e1-8fcf-68c534932ae6" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-769d9faa-4547-48e1-8fcf-68c534932ae6" released by "delete_volume" :: held 0.721s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Created reservations ['25ac47d5-acdf-42d8-ba6c-2858997cb1c9', '6a21207a-7c94-41ce-873c-efd844b8b83b', 'e342126b-c1c4-4e1e-b5a4-554b74d2157a', '601a02c2-0827-4915-876e-698f87e744d0'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:06 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:06 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:06 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892" returned: 0 in 0.376s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:06 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c Nov 05 22:37:06 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:06 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.270s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:06 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Deleted volume successfully. Nov 05 22:37:06 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a545ecab-f12f-4ef6-89ea-c00ae60c79a5 tempest-ProjectMemberTests-19838403 None] Lock "cinder-769d9faa-4547-48e1-8fcf-68c534932ae6-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:07 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:07 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c Nov 05 22:37:07 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (0ee94457-e971-40ce-be92-d6ef5b6ba45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cff8b3c-f08d-4e8b-9bd1-b0765077f982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cff8b3c-f08d-4e8b-9bd1-b0765077f982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831728614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d811228d-1b85-46ed-a863-2715c32fdc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:07Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08689236-1f89-4022-85d1-143d58639962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08689236-1f89-4022-85d1-143d58639962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026b397e-af95-4d56-a5c3-7d8f0e84c725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026b397e-af95-4d56-a5c3-7d8f0e84c725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd811228d-1b85-46ed-a863-2715c32fdc9d', 'volume_name': 'volume-d811228d-1b85-46ed-a863-2715c32fdc9d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:07 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0e875b-399f-4dae-80a3-41d2f5843747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0e875b-399f-4dae-80a3-41d2f5843747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a025af3e-ec5f-4ef3-a0ae-de4c204314f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:07 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Volume d811228d-1b85-46ed-a863-2715c32fdc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d811228d-1b85-46ed-a863-2715c32fdc9d', 'volume_size': 1} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831728614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d811228d-1b85-46ed-a863-2715c32fdc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:07Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Creating volume d811228d-1b85-46ed-a863-2715c32fdc9d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:07 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892.7ded7e16-103f-4b79-be9f-b15d9f5a4f7c" returned: 0 in 0.319s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:07 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d 1073741824 Nov 05 22:37:07 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-7ded7e16-103f-4b79-be9f-b15d9f5a4f7c" released by "_delete_snapshot" :: held 1.527s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-d5ed9981-6ebd-4368-afdc-80125fa14892" released by "delete_snapshot" :: held 1.550s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Created reservations ['90a3e050-0b15-4d53-aed9-c3ee68f05864', '15d3f400-5e9c-4ad9-9e09-cc57a90b60f0', '50e2ab62-eb39-47f2-a220-82185b37f345', '8c9eb704-5e0b-4a50-ba3c-a175c0f64700'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:07 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Delete snapshot completed successfully. Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-415ee6aa-86b1-41f7-a7b1-2303e168fb48 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-7ded7e16-103f-4b79-be9f-b15d9f5a4f7c-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:07 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d 1073741824" returned: 0 in 0.418s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:07 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d Nov 05 22:37:07 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-d5ed9981-6ebd-4368-afdc-80125fa14892-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:07 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-d5ed9981-6ebd-4368-afdc-80125fa14892-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:08 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "cinder-quobyte-d5ed9981-6ebd-4368-afdc-80125fa14892" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a025af3e-ec5f-4ef3-a0ae-de4c204314f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d811228d-1b85-46ed-a863-2715c32fdc9d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9af2cf-08d7-4008-ae2d-eee150d5141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-d5ed9981-6ebd-4368-afdc-80125fa14892" acquired by "delete_volume" :: waited 0.028s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:08 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Volume volume-d811228d-1b85-46ed-a863-2715c32fdc9d (d811228d-1b85-46ed-a863-2715c32fdc9d): created successfully Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9af2cf-08d7-4008-ae2d-eee150d5141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (0ee94457-e971-40ce-be92-d6ef5b6ba45a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaa9135-be59-4f58-8e3d-4ff64f4fa16c]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:08 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-db0f8e67-9140-4f64-9de7-2efa753a13de tempest-ProjectMemberTests-19838403 None] Created volume successfully. Nov 05 22:37:08 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 Nov 05 22:37:08 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Creating offline snapshot e3555616-6879-481e-b4b9-7fbb002922f7 of volume d811228d-1b85-46ed-a863-2715c32fdc9d {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf06f2ff-9a81-4513-b4a6-08657f24cf84]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:08 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:08 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892 Nov 05 22:37:08 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:08 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d Nov 05 22:37:08 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:08 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d5ed9981-6ebd-4368-afdc-80125fa14892" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-quobyte-d5ed9981-6ebd-4368-afdc-80125fa14892" released by "delete_volume" :: held 0.700s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Created reservations ['6a6304e6-4c6e-45bb-b762-993f5af19a66', '7168236d-c2ea-4db4-a6b2-e6c64579ca42', '97598042-eef7-4d97-8674-eca6ee4d95ee', '433576ce-8b91-41c9-8603-36917a290814'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:08 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d" returned: 0 in 0.379s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:08 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 1G Nov 05 22:37:08 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:08 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:08 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:08 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:09 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.267s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:09 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:09 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Deleted volume successfully. Nov 05 22:37:09 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8811d6c4-cc1a-4e92-a85b-2a4c25c97f40 tempest-ProjectReaderTests-1671521057 None] Lock "cinder-d5ed9981-6ebd-4368-afdc-80125fa14892-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:09 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 1G" returned: 0 in 0.454s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d811228d-1b85-46ed-a863-2715c32fdc9d -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:09 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d811228d-1b85-46ed-a863-2715c32fdc9d -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 Nov 05 22:37:09 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:09 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d811228d-1b85-46ed-a863-2715c32fdc9d -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7" returned: 0 in 0.298s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:09 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 is being set with open permissions: ugo+rw Nov 05 22:37:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:09 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 Nov 05 22:37:09 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:09 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:09 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:09 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.info Nov 05 22:37:09 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:10 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.info" returned: 0 in 0.278s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:10 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.info is being set with open permissions: ugo+rw Nov 05 22:37:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:10 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.info Nov 05 22:37:10 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:10 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.info" returned: 0 in 0.266s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:10 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:10 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-17ae4041-103b-456f-992f-02fa65644768 tempest-ProjectMemberTests-19838403 None] Create snapshot completed successfully Nov 05 22:37:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-e3555616-6879-481e-b4b9-7fbb002922f7-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Lock "cinder-e3555616-6879-481e-b4b9-7fbb002922f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-d811228d-1b85-46ed-a863-2715c32fdc9d" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-d811228d-1b85-46ed-a863-2715c32fdc9d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-e3555616-6879-481e-b4b9-7fbb002922f7" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:11 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-e3555616-6879-481e-b4b9-7fbb002922f7" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Deleting offline snapshot e3555616-6879-481e-b4b9-7fbb002922f7 of volume d811228d-1b85-46ed-a863-2715c32fdc9d {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:37:11 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] snapshot_file for this snap is: volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:37:11 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b379af97-e4ce-4e99-b8e3-30613e01ef18]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:11 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:11 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 Nov 05 22:37:11 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:12 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7" returned: 0 in 0.369s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:12 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d811228d-1b85-46ed-a863-2715c32fdc9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:37:12 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7902cc43-4db8-4ad6-bcb0-9472f1c66b0f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:12 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d Nov 05 22:37:12 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:12 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d" returned: 0 in 0.372s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:12 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 Nov 05 22:37:12 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:12 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7" returned: 0 in 0.321s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:12 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:12 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7 Nov 05 22:37:12 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:13 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d.e3555616-6879-481e-b4b9-7fbb002922f7" returned: 0 in 0.239s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-e3555616-6879-481e-b4b9-7fbb002922f7" released by "_delete_snapshot" :: held 1.399s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-d811228d-1b85-46ed-a863-2715c32fdc9d" released by "delete_snapshot" :: held 1.460s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Created reservations ['d3a0fc23-1999-4532-863e-93399a46e485', '44796f25-127c-4eb8-9da4-8d9e45ebd828', '7f114de0-1de3-4861-8fa0-efcd3328d343', 'cf4e35cc-f5d1-404f-8444-1ee8655d0fed'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:13 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Delete snapshot completed successfully. Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bf7268b5-22e5-4793-b4b1-38cf1c92046b tempest-ProjectMemberTests-19838403 None] Lock "cinder-e3555616-6879-481e-b4b9-7fbb002922f7-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-d811228d-1b85-46ed-a863-2715c32fdc9d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Lock "cinder-d811228d-1b85-46ed-a863-2715c32fdc9d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-d811228d-1b85-46ed-a863-2715c32fdc9d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-d811228d-1b85-46ed-a863-2715c32fdc9d" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d30ab6d-09ac-4c42-8978-e81ea862b416]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:13 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:13 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d Nov 05 22:37:13 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:14 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d" returned: 0 in 0.381s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:14 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d Nov 05 22:37:14 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:14 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-d811228d-1b85-46ed-a863-2715c32fdc9d" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-d811228d-1b85-46ed-a863-2715c32fdc9d" released by "delete_volume" :: held 0.684s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Created reservations ['15b60d31-43d3-48d9-9446-d825707a1ced', 'ef714a16-38be-44ce-9c09-53601c521657', '58877b5e-bcfe-47ba-b51e-a1f08e37cffb', '285e4770-4a7c-4e72-a2ef-2f27795bd527'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:14 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:14 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:14 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.245s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:14 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Deleted volume successfully. Nov 05 22:37:14 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-f041dbb3-4103-489c-b506-1baef56dfc0d tempest-ProjectMemberTests-19838403 None] Lock "cinder-d811228d-1b85-46ed-a863-2715c32fdc9d-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (43dd8eeb-3c47-4758-b811-7b02041ccd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddc30b0-07fb-4563-8e05-a5e4a4fe3f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddc30b0-07fb-4563-8e05-a5e4a4fe3f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-341590228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de5d96c-1a6b-4408-8cf3-39f9418baa19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:15Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3592a629-ea31-4737-8f7b-76b2c9254939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3592a629-ea31-4737-8f7b-76b2c9254939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcba9197-6de3-498e-b0f1-54de4aeb3550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcba9197-6de3-498e-b0f1-54de4aeb3550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0de5d96c-1a6b-4408-8cf3-39f9418baa19', 'volume_name': 'volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0470275b-a2b1-4861-ac83-6fb3dd3e9d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0470275b-a2b1-4861-ac83-6fb3dd3e9d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb59423-94df-42e1-955e-df0044b09fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:15 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Volume 0de5d96c-1a6b-4408-8cf3-39f9418baa19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19', 'volume_size': 1} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-341590228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0de5d96c-1a6b-4408-8cf3-39f9418baa19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:15Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Creating volume 0de5d96c-1a6b-4408-8cf3-39f9418baa19 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:15 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:15 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 1073741824 Nov 05 22:37:15 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:15 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:15 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 1073741824" returned: 0 in 0.501s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:16 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 Nov 05 22:37:16 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:16 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:16 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:37:16 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb59423-94df-42e1-955e-df0044b09fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9359585b-f7f9-4773-ad46-08c8d0162693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:16 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Volume volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 (0de5d96c-1a6b-4408-8cf3-39f9418baa19): created successfully Nov 05 22:37:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9359585b-f7f9-4773-ad46-08c8d0162693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:16 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (43dd8eeb-3c47-4758-b811-7b02041ccd73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:16 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-09905619-a0c3-4cf7-969c-7ebdfb21b105 tempest-ProjectMemberTests-19838403 None] Created volume successfully. Nov 05 22:37:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:17 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Creating offline snapshot 25f87da2-fc22-4478-8b39-4e7a4cd053c6 of volume 0de5d96c-1a6b-4408-8cf3-39f9418baa19 {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:37:17 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf303b82-9c17-4e2d-bb80-718c2114c087]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:17 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 Nov 05 22:37:17 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:17 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:17 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:18 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 1G Nov 05 22:37:18 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:18 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 1G" returned: 0 in 0.436s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:18 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 Nov 05 22:37:18 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:18 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:18 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 is being set with open permissions: ugo+rw Nov 05 22:37:18 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:18 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 Nov 05 22:37:18 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:18 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:19 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.info Nov 05 22:37:19 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:19 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.info" returned: 0 in 0.262s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:19 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.info is being set with open permissions: ugo+rw Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:19 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.info Nov 05 22:37:19 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:19 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.info" returned: 0 in 0.245s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:19 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-ecaa9073-3943-449f-81a2-08cfb2423a38 tempest-ProjectMemberTests-19838403 None] Create snapshot completed successfully Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-25f87da2-fc22-4478-8b39-4e7a4cd053c6-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Lock "cinder-25f87da2-fc22-4478-8b39-4e7a4cd053c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-0de5d96c-1a6b-4408-8cf3-39f9418baa19" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-0de5d96c-1a6b-4408-8cf3-39f9418baa19" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-25f87da2-fc22-4478-8b39-4e7a4cd053c6" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-25f87da2-fc22-4478-8b39-4e7a4cd053c6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Deleting offline snapshot 25f87da2-fc22-4478-8b39-4e7a4cd053c6 of volume 0de5d96c-1a6b-4408-8cf3-39f9418baa19 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] snapshot_file for this snap is: volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df04b787-9178-41a5-85b3-53869acb6fbd]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:19 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:19 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 Nov 05 22:37:19 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:20 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6" returned: 0 in 0.395s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:20 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:37:20 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d87b3e7-2f0f-484c-b997-d848fb71b91e]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:20 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 Nov 05 22:37:20 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:20 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19" returned: 0 in 0.383s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:20 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:20 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 Nov 05 22:37:20 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:21 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6" returned: 0 in 0.378s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:21 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6 Nov 05 22:37:21 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:21 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:21 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19.25f87da2-fc22-4478-8b39-4e7a4cd053c6" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-25f87da2-fc22-4478-8b39-4e7a4cd053c6" released by "_delete_snapshot" :: held 1.511s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-0de5d96c-1a6b-4408-8cf3-39f9418baa19" released by "delete_snapshot" :: held 1.534s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:21 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Created reservations ['23ff6a9b-b6ff-44e7-a452-daa84bb27a96', '4d99d898-9a08-4b74-b85d-e1ece1e696e5', '6fe90614-417c-4e03-938b-4ae90da68e77', '4330d620-575f-4eac-9779-16444d0e0861'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:21 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Delete snapshot completed successfully. Nov 05 22:37:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b4d7ec01-47e5-49f5-9ff8-242a7c27eb19 tempest-ProjectMemberTests-19838403 None] Lock "cinder-25f87da2-fc22-4478-8b39-4e7a4cd053c6-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-0de5d96c-1a6b-4408-8cf3-39f9418baa19-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-0de5d96c-1a6b-4408-8cf3-39f9418baa19-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:21 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-0de5d96c-1a6b-4408-8cf3-39f9418baa19" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-0de5d96c-1a6b-4408-8cf3-39f9418baa19" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[03952b5d-68e8-4a4f-860f-b13c0b8cb734]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:22 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 Nov 05 22:37:22 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:22 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19" returned: 0 in 0.365s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:22 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19 Nov 05 22:37:22 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:22 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-0de5d96c-1a6b-4408-8cf3-39f9418baa19" returned: 0 in 0.255s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-0de5d96c-1a6b-4408-8cf3-39f9418baa19" released by "delete_volume" :: held 0.698s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Created reservations ['0add2d0f-2a67-4207-8d61-cf6bf0d6d03b', '7b0a13ce-0a0c-4aa3-878d-5b03d2246c0c', '71f3329e-0f3a-47d3-a6a6-8c327f8a2590', '7caa5870-9db2-4008-a4c9-c7e729527648'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:22 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:22 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:22 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:23 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:23 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Deleted volume successfully. Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-a8ef557f-75ab-486d-bcb2-663340b571e3 tempest-ProjectMemberTests-19838403 None] Lock "cinder-0de5d96c-1a6b-4408-8cf3-39f9418baa19-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (c18fc106-c5ca-4ef5-8670-2190bf063fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587f6f9b-9490-45e7-8ecb-41d481e134fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587f6f9b-9490-45e7-8ecb-41d481e134fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864858871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18cd126-d506-42e4-93f4-637c1d1d43da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:24Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b7c5e0-4a44-49ed-8443-d21734cf1161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b7c5e0-4a44-49ed-8443-d21734cf1161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58bb009-4273-4b1d-b91e-70263a213ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58bb009-4273-4b1d-b91e-70263a213ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18cd126-d506-42e4-93f4-637c1d1d43da', 'volume_name': 'volume-f18cd126-d506-42e4-93f4-637c1d1d43da', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ae9f00-8b31-45b1-af44-d7926338aa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ae9f00-8b31-45b1-af44-d7926338aa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb8265c-535c-47ce-8193-50f0d46d3aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:23 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Volume f18cd126-d506-42e4-93f4-637c1d1d43da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18cd126-d506-42e4-93f4-637c1d1d43da', 'volume_size': 1} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864858871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18cd126-d506-42e4-93f4-637c1d1d43da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d07bde6457e4320866ad2dd926c39b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:24Z,use_quota=True,user_id='e64de30133804a0badb702433a21f644',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Creating volume f18cd126-d506-42e4-93f4-637c1d1d43da {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:23 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:37:23 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:23 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da 1073741824 Nov 05 22:37:23 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:24 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da 1073741824" returned: 0 in 0.568s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:24 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da Nov 05 22:37:24 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:24 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da" returned: 0 in 0.262s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:24 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:37:24 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb8265c-535c-47ce-8193-50f0d46d3aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18cd126-d506-42e4-93f4-637c1d1d43da', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab71f26-2c7f-4edd-a7a8-e9b1b89850a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:24 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Volume volume-f18cd126-d506-42e4-93f4-637c1d1d43da (f18cd126-d506-42e4-93f4-637c1d1d43da): created successfully Nov 05 22:37:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab71f26-2c7f-4edd-a7a8-e9b1b89850a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:24 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Flow 'volume_create_manager' (c18fc106-c5ca-4ef5-8670-2190bf063fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:24 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-22e8f648-ad82-41da-9acf-2f0449de6996 tempest-ProjectMemberTests-19838403 None] Created volume successfully. Nov 05 22:37:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:25 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Creating offline snapshot 409427b9-fb6e-49cc-91cb-9afae155ff51 of volume f18cd126-d506-42e4-93f4-637c1d1d43da {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:37:25 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66ed79-c7ca-492d-9dba-817704b35a14]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:25 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:25 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da Nov 05 22:37:25 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:26 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da" returned: 0 in 0.398s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:26 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 1G Nov 05 22:37:26 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:26 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 1G" returned: 0 in 0.440s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:26 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18cd126-d506-42e4-93f4-637c1d1d43da -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:26 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18cd126-d506-42e4-93f4-637c1d1d43da -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 Nov 05 22:37:26 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:27 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18cd126-d506-42e4-93f4-637c1d1d43da -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51" returned: 0 in 0.303s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:27 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 is being set with open permissions: ugo+rw Nov 05 22:37:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:27 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 Nov 05 22:37:27 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:27 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51" returned: 0 in 0.255s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:27 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.info Nov 05 22:37:27 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:27 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.info" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:27 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.info is being set with open permissions: ugo+rw Nov 05 22:37:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:27 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.info Nov 05 22:37:27 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:27 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.info" returned: 0 in 0.251s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:27 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:27 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7d3c61d2-b9ba-4fa9-9e6f-9850c3f5e81b tempest-ProjectMemberTests-19838403 None] Create snapshot completed successfully Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-409427b9-fb6e-49cc-91cb-9afae155ff51-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Lock "cinder-409427b9-fb6e-49cc-91cb-9afae155ff51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-f18cd126-d506-42e4-93f4-637c1d1d43da" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-f18cd126-d506-42e4-93f4-637c1d1d43da" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-409427b9-fb6e-49cc-91cb-9afae155ff51" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-409427b9-fb6e-49cc-91cb-9afae155ff51" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Deleting offline snapshot 409427b9-fb6e-49cc-91cb-9afae155ff51 of volume f18cd126-d506-42e4-93f4-637c1d1d43da {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] snapshot_file for this snap is: volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5f8d40-e7b1-4122-8aaa-9912e2ff8fbc]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:29 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 Nov 05 22:37:29 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:29 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51" returned: 0 in 0.388s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18cd126-d506-42e4-93f4-637c1d1d43da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b283be-eeb8-4b06-8cd7-d3df9333c0ff]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:29 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:29 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da Nov 05 22:37:29 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:30 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da" returned: 0 in 0.376s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:30 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 Nov 05 22:37:30 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:30 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51" returned: 0 in 0.361s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:30 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51 Nov 05 22:37:30 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:30 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da.409427b9-fb6e-49cc-91cb-9afae155ff51" returned: 0 in 0.275s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-409427b9-fb6e-49cc-91cb-9afae155ff51" released by "_delete_snapshot" :: held 1.514s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-f18cd126-d506-42e4-93f4-637c1d1d43da" released by "delete_snapshot" :: held 1.537s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=170,cinder:DELETE=20,cinder:UPDATE=189,cinder:INSERT=48 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=153,cinder:INSERT=66,cinder:UPDATE=218,cinder:DELETE=14 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Created reservations ['4db96bc5-e4bf-43b4-8fdd-dbb6d5bbae1e', '223dad31-897c-4600-8cea-f3684c1caecc', '6e5f4218-4e45-4ad4-9d4a-99d58eeba669', '973f079d-8d3a-4b04-8b0b-84d6a98031e8'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:30 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Delete snapshot completed successfully. Nov 05 22:37:30 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-2850a06b-645a-415e-bb04-148f27b7eddd tempest-ProjectMemberTests-19838403 None] Lock "cinder-409427b9-fb6e-49cc-91cb-9afae155ff51-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-f18cd126-d506-42e4-93f4-637c1d1d43da-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Lock "cinder-f18cd126-d506-42e4-93f4-637c1d1d43da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Acquiring lock "cinder-quobyte-f18cd126-d506-42e4-93f4-637c1d1d43da" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:31 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-f18cd126-d506-42e4-93f4-637c1d1d43da" acquired by "delete_volume" :: waited 0.015s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:31 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c10431-25fc-4e67-a8ef-90c4be674f38]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:31 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da Nov 05 22:37:31 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:31 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da" returned: 0 in 0.413s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:31 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:31 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da Nov 05 22:37:31 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:32 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-f18cd126-d506-42e4-93f4-637c1d1d43da" returned: 0 in 0.254s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Lock "cinder-quobyte-f18cd126-d506-42e4-93f4-637c1d1d43da" released by "delete_volume" :: held 0.752s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Created reservations ['155e9b4a-be6f-4e97-b592-37327d5eb215', '16b25570-2b20-4d1a-ba5b-ef6b69b662ce', '65057d4d-6518-4a55-ab6d-8394b63d8131', 'd32ac355-ebec-4adf-9b42-e2ecc1ad1d9c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:32 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:32 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:32 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.280s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:32 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Deleted volume successfully. Nov 05 22:37:32 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bba33258-8380-4619-9c20-9c3e8235e923 tempest-ProjectMemberTests-19838403 None] Lock "cinder-f18cd126-d506-42e4-93f4-637c1d1d43da-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Flow 'volume_create_manager' (01c670e6-2276-4dbd-806a-b2c2ee0223c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba629fb0-406a-43e2-bd8f-c1114e3e501e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba629fb0-406a-43e2-bd8f-c1114e3e501e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280191504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15371cd7-ab80-4d19-8b73-762df1ca0448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1d4a3002404ecbbb8b797a0eb83dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:37Z,use_quota=True,user_id='c9fd477609334f0d844e74df9571f20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d829e15a-f3be-4cec-aaab-c99f483e3763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d829e15a-f3be-4cec-aaab-c99f483e3763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031f255d-d828-4d73-9da6-447eedfb61ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031f255d-d828-4d73-9da6-447eedfb61ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15371cd7-ab80-4d19-8b73-762df1ca0448', 'volume_name': 'volume-15371cd7-ab80-4d19-8b73-762df1ca0448', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ff060e-19df-4556-a653-c0e43cfdd1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ff060e-19df-4556-a653-c0e43cfdd1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0811951c-e943-4335-abfe-a42cab8b0e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:36 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Volume 15371cd7-ab80-4d19-8b73-762df1ca0448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15371cd7-ab80-4d19-8b73-762df1ca0448', 'volume_size': 1} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280191504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15371cd7-ab80-4d19-8b73-762df1ca0448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1d4a3002404ecbbb8b797a0eb83dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:37Z,use_quota=True,user_id='c9fd477609334f0d844e74df9571f20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Creating volume 15371cd7-ab80-4d19-8b73-762df1ca0448 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:36 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:37:36 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:36 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448 1073741824 Nov 05 22:37:36 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:37 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448 1073741824" returned: 0 in 0.477s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:37 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448 Nov 05 22:37:37 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:37 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:37 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:37:37 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0811951c-e943-4335-abfe-a42cab8b0e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15371cd7-ab80-4d19-8b73-762df1ca0448', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc3084a-2dff-47c8-be0c-6189c4990109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:37 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Volume volume-15371cd7-ab80-4d19-8b73-762df1ca0448 (15371cd7-ab80-4d19-8b73-762df1ca0448): created successfully Nov 05 22:37:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc3084a-2dff-47c8-be0c-6189c4990109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:37 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Flow 'volume_create_manager' (01c670e6-2276-4dbd-806a-b2c2ee0223c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:37 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bdb77399-c336-4744-8a9b-f02faaf447a3 tempest-ProjectReaderTests-340850064 None] Created volume successfully. Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Flow 'volume_create_manager' (7e4e2e02-e83e-4486-958d-ba1d11c5925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddf61ba-58aa-4643-9f60-1734fe174b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddf61ba-58aa-4643-9f60-1734fe174b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-685439075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa30a084-718c-4fb1-a16c-f274b2f4386d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f80eaa4e2344bf9d65ea9469b4ea7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:38Z,use_quota=True,user_id='20dfe3e828ce4890a291ee2282638a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb54079-a294-4d83-816e-8f66ea977d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb54079-a294-4d83-816e-8f66ea977d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b97f9c-3de9-409a-a760-e00d6c5dd416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b97f9c-3de9-409a-a760-e00d6c5dd416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa30a084-718c-4fb1-a16c-f274b2f4386d', 'volume_name': 'volume-aa30a084-718c-4fb1-a16c-f274b2f4386d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0ea690-80d8-41e6-ab65-040b830d1173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0ea690-80d8-41e6-ab65-040b830d1173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9198a2ed-0105-4019-82b9-bf8e688eb153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:38 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Volume aa30a084-718c-4fb1-a16c-f274b2f4386d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa30a084-718c-4fb1-a16c-f274b2f4386d', 'volume_size': 1} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-685439075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa30a084-718c-4fb1-a16c-f274b2f4386d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f80eaa4e2344bf9d65ea9469b4ea7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:38Z,use_quota=True,user_id='20dfe3e828ce4890a291ee2282638a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Creating volume aa30a084-718c-4fb1-a16c-f274b2f4386d {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:38 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:38 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d 1073741824 Nov 05 22:37:38 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:38 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d 1073741824" returned: 0 in 0.437s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:38 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:38 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d Nov 05 22:37:38 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Acquiring lock "cinder-15371cd7-ab80-4d19-8b73-762df1ca0448-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Lock "cinder-15371cd7-ab80-4d19-8b73-762df1ca0448-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Acquiring lock "cinder-quobyte-15371cd7-ab80-4d19-8b73-762df1ca0448" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Lock "cinder-quobyte-15371cd7-ab80-4d19-8b73-762df1ca0448" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe19a4d-9bba-458f-a821-00f07fa348b5]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:39 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9198a2ed-0105-4019-82b9-bf8e688eb153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa30a084-718c-4fb1-a16c-f274b2f4386d', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad47d8c-1977-49c3-b0e7-8a181b8ef36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:39 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Volume volume-aa30a084-718c-4fb1-a16c-f274b2f4386d (aa30a084-718c-4fb1-a16c-f274b2f4386d): created successfully Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad47d8c-1977-49c3-b0e7-8a181b8ef36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Flow 'volume_create_manager' (7e4e2e02-e83e-4486-958d-ba1d11c5925b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:39 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-069c4b8f-96c6-476c-923f-cbc6677760cc tempest-SnapshotDependencyTests-633086996 None] Created volume successfully. Nov 05 22:37:39 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448 Nov 05 22:37:39 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:39 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448" returned: 0 in 0.366s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:39 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448 Nov 05 22:37:39 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Creating offline snapshot 552b22d4-9cff-45c1-a033-ff3217dbde4c of volume aa30a084-718c-4fb1-a16c-f274b2f4386d {{(pid=87122) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[50165f84-9552-4cff-9f60-91b0e63ea36d]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:39 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15371cd7-ab80-4d19-8b73-762df1ca0448" returned: 0 in 0.253s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Lock "cinder-quobyte-15371cd7-ab80-4d19-8b73-762df1ca0448" released by "delete_volume" :: held 0.666s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:39 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d Nov 05 22:37:39 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Created reservations ['f6c8f24c-8789-4ac3-9c6a-632c8fddf263', '1bbb4ede-dd51-40d6-9a26-16f6f7b34e27', 'b7b95b37-dbc9-4d41-bbb5-7966dc8dd125', 'd49e7b00-432c-4e99-b6ee-0e5d6a698e26'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:39 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:39 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:39 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:39 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d" returned: 0 in 0.355s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c 1G {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:40 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c 1G Nov 05 22:37:40 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:40 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.259s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:40 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Deleted volume successfully. Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-61bea516-6ab9-4f34-a90f-4f283907cf55 tempest-ProjectReaderTests-340850064 None] Lock "cinder-15371cd7-ab80-4d19-8b73-762df1ca0448-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:40 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c 1G" returned: 0 in 0.394s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa30a084-718c-4fb1-a16c-f274b2f4386d -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:40 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa30a084-718c-4fb1-a16c-f274b2f4386d -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c Nov 05 22:37:40 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Flow 'volume_create_manager' (ca310f0a-a1d8-4958-abc9-be505d33bc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17659e8-160b-45db-9881-2ef7780afbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17659e8-160b-45db-9881-2ef7780afbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941136030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81d5c95-5681-4bdb-840a-8b58ffacb3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1d4a3002404ecbbb8b797a0eb83dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:41Z,use_quota=True,user_id='c9fd477609334f0d844e74df9571f20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f770fc4f-d408-45bb-89ed-fcc0a39eb422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f770fc4f-d408-45bb-89ed-fcc0a39eb422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ad3f98-54a6-4079-8784-7e7a32de2519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ad3f98-54a6-4079-8784-7e7a32de2519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b81d5c95-5681-4bdb-840a-8b58ffacb3bb', 'volume_name': 'volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b54905-76ff-4c71-ad5e-7208de086ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:40 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b54905-76ff-4c71-ad5e-7208de086ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52def090-19dd-4f76-b293-6ab64e8fc4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:40 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Volume b81d5c95-5681-4bdb-840a-8b58ffacb3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb', 'volume_size': 1} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa30a084-718c-4fb1-a16c-f274b2f4386d -F qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c" returned: 0 in 0.312s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:40 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c is being set with open permissions: ugo+rw Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:40 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c Nov 05 22:37:40 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:40 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c" returned: 0 in 0.237s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:40 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:41 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.info Nov 05 22:37:41 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:41 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.info" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:41 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.info is being set with open permissions: ugo+rw Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.info {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:41 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.info Nov 05 22:37:41 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:41 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.info" returned: 0 in 0.241s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941136030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81d5c95-5681-4bdb-840a-8b58ffacb3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1d4a3002404ecbbb8b797a0eb83dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:41Z,use_quota=True,user_id='c9fd477609334f0d844e74df9571f20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Creating volume b81d5c95-5681-4bdb-840a-8b58ffacb3bb {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:41 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:41 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb 1073741824 Nov 05 22:37:41 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:41 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-69b4ccd6-7963-4096-835e-a245728ff511 tempest-SnapshotDependencyTests-633086996 None] Create snapshot completed successfully Nov 05 22:37:41 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb 1073741824" returned: 0 in 0.452s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:41 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:42 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb Nov 05 22:37:42 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:42 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb" returned: 0 in 0.249s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52def090-19dd-4f76-b293-6ab64e8fc4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd47c99c-3330-40b0-be27-fcfd675c66a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Volume volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb (b81d5c95-5681-4bdb-840a-8b58ffacb3bb): created successfully Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd47c99c-3330-40b0-be27-fcfd675c66a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Flow 'volume_create_manager' (ca310f0a-a1d8-4958-abc9-be505d33bc96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:42 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-aeb615e7-6831-463b-9a64-4113f832c0ff tempest-ProjectReaderTests-340850064 None] Created volume successfully. Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Flow 'volume_create_manager' (3fe3b2b2-0407-4bf8-99c3-a62666a6a98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb3f33d-2722-4899-a7c9-2dc8d86d312e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb3f33d-2722-4899-a7c9-2dc8d86d312e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7855ceeb-3151-40b9-8012-4e8dea3650fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28f80eaa4e2344bf9d65ea9469b4ea7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=552b22d4-9cff-45c1-a033-ff3217dbde4c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:42Z,use_quota=True,user_id='20dfe3e828ce4890a291ee2282638a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6415cc4a-74a7-4548-bbae-8a58972c4795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6415cc4a-74a7-4548-bbae-8a58972c4795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b7cd40-e885-4c83-98ab-ee85e2520290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b7cd40-e885-4c83-98ab-ee85e2520290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7855ceeb-3151-40b9-8012-4e8dea3650fc', 'volume_name': 'volume-7855ceeb-3151-40b9-8012-4e8dea3650fc', 'volume_size': 1, 'snapshot_id': '552b22d4-9cff-45c1-a033-ff3217dbde4c'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db92c02f-3fbb-47f1-8a2f-4c498b3298be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db92c02f-3fbb-47f1-8a2f-4c498b3298be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77af7138-719c-4d5d-ab26-3a0ca594bc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:42 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Volume 7855ceeb-3151-40b9-8012-4e8dea3650fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7855ceeb-3151-40b9-8012-4e8dea3650fc', 'volume_size': 1, 'snapshot_id': '552b22d4-9cff-45c1-a033-ff3217dbde4c'} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "cinder-quobyte-552b22d4-9cff-45c1-a033-ff3217dbde4c-7855ceeb-3151-40b9-8012-4e8dea3650fc" by "_create_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-552b22d4-9cff-45c1-a033-ff3217dbde4c-7855ceeb-3151-40b9-8012-4e8dea3650fc" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Creating volume 7855ceeb-3151-40b9-8012-4e8dea3650fc from snapshot 552b22d4-9cff-45c1-a033-ff3217dbde4c {{(pid=87122) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "cinder-quobyte-7855ceeb-3151-40b9-8012-4e8dea3650fc" by "_copy_volume_from_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-7855ceeb-3151-40b9-8012-4e8dea3650fc" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] snapshot: 552b22d4-9cff-45c1-a033-ff3217dbde4c, volume: 7855ceeb-3151-40b9-8012-4e8dea3650fc, {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b3a0cf-2c71-4fda-bb94-9fa4824659ba]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:42 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c Nov 05 22:37:42 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Acquiring lock "cinder-b81d5c95-5681-4bdb-840a-8b58ffacb3bb-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Lock "cinder-b81d5c95-5681-4bdb-840a-8b58ffacb3bb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Acquiring lock "cinder-quobyte-b81d5c95-5681-4bdb-840a-8b58ffacb3bb" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Lock "cinder-quobyte-b81d5c95-5681-4bdb-840a-8b58ffacb3bb" acquired by "delete_volume" :: waited 0.016s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30e2a60-7a66-4933-9174-74dbba9de7f7]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:42 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c" returned: 0 in 0.393s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa30a084-718c-4fb1-a16c-f274b2f4386d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e666204d-6170-498f-9aae-3850f42c9553]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:42 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:42 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb Nov 05 22:37:42 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:43 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d Nov 05 22:37:43 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:43 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb" returned: 0 in 0.396s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:43 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d" returned: 0 in 0.380s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] will copy from snapshot at /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:37:43 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb Nov 05 22:37:43 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Creating direct copy from snapshot {{(pid=87122) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG cinder.utils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Path /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc not found in is_blk_device check {{(pid=87122) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:43 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc Nov 05 22:37:43 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:43 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-b81d5c95-5681-4bdb-840a-8b58ffacb3bb" returned: 0 in 0.249s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Lock "cinder-quobyte-b81d5c95-5681-4bdb-840a-8b58ffacb3bb" released by "delete_volume" :: held 0.688s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Created reservations ['2b9e105f-d4d2-4787-9289-271db058428b', 'd137690a-bc32-4527-9a21-2ed7a136edc2', 'f2b2c5c3-9b3d-46c7-8de9-b269f59cc085', '978fbb20-1498-4877-bc2e-4543c10f915d'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:43 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:43 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:43 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:44 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:44 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.355s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:44 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:44 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Deleted volume successfully. Nov 05 22:37:44 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-12a3ccf6-3a6f-4492-b60f-a15d38372119 tempest-ProjectReaderTests-340850064 None] Lock "cinder-b81d5c95-5681-4bdb-840a-8b58ffacb3bb-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:49 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Flow 'volume_create_manager' (203ec6ff-b1d5-43fd-93b5-7d5e5903b52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae80021-5afe-43bd-9c49-2cd4e4ddf3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae80021-5afe-43bd-9c49-2cd4e4ddf3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919216560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fab995-dbdf-4d75-afce-f765451c86f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6dc03308174d60b2c1a00eac10fb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:50Z,use_quota=True,user_id='ac6690018bb44812bfcd131a7428f052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4564ec3-5c58-44de-a347-2013d3cb7152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4564ec3-5c58-44de-a347-2013d3cb7152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcdfb10-1cef-40c1-a0d6-b64afc80c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcdfb10-1cef-40c1-a0d6-b64afc80c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81fab995-dbdf-4d75-afce-f765451c86f6', 'volume_name': 'volume-81fab995-dbdf-4d75-afce-f765451c86f6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee92418a-fff3-414e-9eb8-65656a512c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:49 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee92418a-fff3-414e-9eb8-65656a512c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398f896f-879d-4467-966f-8680899333eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Volume 81fab995-dbdf-4d75-afce-f765451c86f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81fab995-dbdf-4d75-afce-f765451c86f6', 'volume_size': 1} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:50 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc" returned: 0 in 6.972s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.image.image_utils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Image conversion details: src /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc {{(pid=87122) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:37:50 devstack cinder-volume[87122]: INFO cinder.image.image_utils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Converted 1024.00 MB image at 146.85 MB/s Nov 05 22:37:50 devstack cinder-volume[87122]: WARNING cinder.volume.drivers.remotefs [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc is being set with open permissions: ugo+rw Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:50 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc Nov 05 22:37:50 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:50 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc" returned: 0 in 0.229s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-7855ceeb-3151-40b9-8012-4e8dea3650fc" released by "_copy_volume_from_snapshot" :: held 8.048s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-552b22d4-9cff-45c1-a033-ff3217dbde4c-7855ceeb-3151-40b9-8012-4e8dea3650fc" released by "_create_volume_from_snapshot" :: held 8.108s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.124s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919216560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fab995-dbdf-4d75-afce-f765451c86f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6dc03308174d60b2c1a00eac10fb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:50Z,use_quota=True,user_id='ac6690018bb44812bfcd131a7428f052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Creating volume 81fab995-dbdf-4d75-afce-f765451c86f6 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:50 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:50 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6 1073741824 Nov 05 22:37:50 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77af7138-719c-4d5d-ab26-3a0ca594bc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7855ceeb-3151-40b9-8012-4e8dea3650fc', 'volume_size': 1, 'snapshot_id': '552b22d4-9cff-45c1-a033-ff3217dbde4c'}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18fddea4-38d7-4358-8551-8dc4ada8f839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:50 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Volume volume-7855ceeb-3151-40b9-8012-4e8dea3650fc (7855ceeb-3151-40b9-8012-4e8dea3650fc): created successfully Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18fddea4-38d7-4358-8551-8dc4ada8f839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Flow 'volume_create_manager' (3fe3b2b2-0407-4bf8-99c3-a62666a6a98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:50 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-dd8110ef-cd2f-4d59-b73d-479ea5090e3e tempest-SnapshotDependencyTests-633086996 None] Created volume successfully. Nov 05 22:37:50 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6 1073741824" returned: 0 in 0.404s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:50 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:51 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6 Nov 05 22:37:51 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "cinder-552b22d4-9cff-45c1-a033-ff3217dbde4c-delete_snapshot" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-552b22d4-9cff-45c1-a033-ff3217dbde4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "cinder-quobyte-aa30a084-718c-4fb1-a16c-f274b2f4386d" by "delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-aa30a084-718c-4fb1-a16c-f274b2f4386d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "cinder-quobyte-552b22d4-9cff-45c1-a033-ff3217dbde4c" by "_delete_snapshot" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-552b22d4-9cff-45c1-a033-ff3217dbde4c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Deleting offline snapshot 552b22d4-9cff-45c1-a033-ff3217dbde4c of volume aa30a084-718c-4fb1-a16c-f274b2f4386d {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] snapshot_file for this snap is: volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c {{(pid=87122) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b128a96-da4e-43e5-9fe1-bda61d544837]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:51 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6" returned: 0 in 0.240s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398f896f-879d-4467-966f-8680899333eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fab995-dbdf-4d75-afce-f765451c86f6', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7da318-477f-40c7-8b60-956e86296263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:51 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Volume volume-81fab995-dbdf-4d75-afce-f765451c86f6 (81fab995-dbdf-4d75-afce-f765451c86f6): created successfully Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7da318-477f-40c7-8b60-956e86296263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Flow 'volume_create_manager' (203ec6ff-b1d5-43fd-93b5-7d5e5903b52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:51 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-7849d470-ca85-4407-b5fe-e47c69139b79 tempest-ProjectReaderTests-838257960 None] Created volume successfully. Nov 05 22:37:51 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c Nov 05 22:37:51 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:51 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c" returned: 0 in 0.340s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa30a084-718c-4fb1-a16c-f274b2f4386d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87122) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb37ab0-842c-445d-997c-046bdd82ade4]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:51 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:51 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d Nov 05 22:37:51 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Acquiring lock "cinder-81fab995-dbdf-4d75-afce-f765451c86f6-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-81fab995-dbdf-4d75-afce-f765451c86f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Acquiring lock "cinder-quobyte-81fab995-dbdf-4d75-afce-f765451c86f6" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-quobyte-81fab995-dbdf-4d75-afce-f765451c86f6" acquired by "delete_volume" :: waited 0.026s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:52 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2248b91-e72a-4837-b5a4-c34a177c3149]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d" returned: 0 in 0.555s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:52 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c Nov 05 22:37:52 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:52 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6 Nov 05 22:37:52 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:52 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c" returned: 0 in 0.338s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:52 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6" returned: 0 in 0.365s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:52 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c Nov 05 22:37:52 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:52 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6 Nov 05 22:37:52 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:52 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-81fab995-dbdf-4d75-afce-f765451c86f6" returned: 0 in 0.244s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:52 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d.552b22d4-9cff-45c1-a033-ff3217dbde4c" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-quobyte-81fab995-dbdf-4d75-afce-f765451c86f6" released by "delete_volume" :: held 0.654s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-552b22d4-9cff-45c1-a033-ff3217dbde4c" released by "_delete_snapshot" :: held 1.614s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-aa30a084-718c-4fb1-a16c-f274b2f4386d" released by "delete_snapshot" :: held 1.636s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Created reservations ['c88c5948-c7d4-4609-b726-5081ee9d2c05', '6b33cb8d-2ac1-4580-8cba-dc3258484410', 'e045e16c-6f65-4f05-9aee-f02ab3414d65', '601efef0-58fe-412d-a3a2-c75451ddedd6'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Created reservations ['8f073f7f-0174-4909-8e92-7dba769c6214', 'ea388fd7-57a5-4814-b925-ed49f10bc70f', '21deecac-5d18-4462-9526-438f141f9e8a', 'f5f656ca-7cec-4e6d-a6d8-b705273d0c96'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:52 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:52 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:52 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Delete snapshot completed successfully. Nov 05 22:37:52 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-bafa58ee-38b6-43ab-b98a-96cf3dca76a0 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-552b22d4-9cff-45c1-a033-ff3217dbde4c-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:53 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.252s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:53 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Deleted volume successfully. Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-27ce6455-6024-4b6c-825d-8f12c3a815f3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-81fab995-dbdf-4d75-afce-f765451c86f6-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "cinder-aa30a084-718c-4fb1-a16c-f274b2f4386d-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-aa30a084-718c-4fb1-a16c-f274b2f4386d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "cinder-quobyte-aa30a084-718c-4fb1-a16c-f274b2f4386d" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-aa30a084-718c-4fb1-a16c-f274b2f4386d" acquired by "delete_volume" :: waited 0.014s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf6c911-d357-4f1e-a7bc-fe2dd34e39b3]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:53 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d Nov 05 22:37:53 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Flow 'volume_create_manager' (af543176-255a-4e23-9e00-6b1993ea0430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c09af0-a438-462b-a1f3-c08b752c7640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c09af0-a438-462b-a1f3-c08b752c7640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1249528078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a0d90b-8ef3-4821-b095-14f9cbd714da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6dc03308174d60b2c1a00eac10fb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:54Z,use_quota=True,user_id='ac6690018bb44812bfcd131a7428f052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131fa875-8af2-4df0-81bc-487d28f83e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131fa875-8af2-4df0-81bc-487d28f83e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1061255-ec1b-425f-b942-b01705d8532f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1061255-ec1b-425f-b942-b01705d8532f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a0d90b-8ef3-4821-b095-14f9cbd714da', 'volume_name': 'volume-15a0d90b-8ef3-4821-b095-14f9cbd714da', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a9ae98-b3e2-4042-a0d7-7dfcd9738a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a9ae98-b3e2-4042-a0d7-7dfcd9738a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330e3a0c-8e5e-4269-bbf0-ed92737d31ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:53 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Volume 15a0d90b-8ef3-4821-b095-14f9cbd714da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a0d90b-8ef3-4821-b095-14f9cbd714da', 'volume_size': 1} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1249528078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a0d90b-8ef3-4821-b095-14f9cbd714da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6dc03308174d60b2c1a00eac10fb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:54Z,use_quota=True,user_id='ac6690018bb44812bfcd131a7428f052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Creating volume 15a0d90b-8ef3-4821-b095-14f9cbd714da {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:53 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:53 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d" returned: 0 in 0.389s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:53 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:53 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da 1073741824 Nov 05 22:37:53 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:53 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d Nov 05 22:37:53 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:54 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-aa30a084-718c-4fb1-a16c-f274b2f4386d" returned: 0 in 0.257s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-aa30a084-718c-4fb1-a16c-f274b2f4386d" released by "delete_volume" :: held 0.713s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Created reservations ['61100b99-52ad-42a6-8bac-d27ca09a8c0b', 'fd38e2f9-3dd4-4ce3-a3e0-0863d203b9ef', 'e7e869b3-cfd6-4399-8eb9-d3ba7e7f29ef', '3342c1c1-8a83-4dc5-b683-71c1cbebaf7c'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:54 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:54 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:54 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da 1073741824" returned: 0 in 0.452s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:54 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da Nov 05 22:37:54 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:54 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.238s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Deleted volume successfully. Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-1d00a849-4780-48f5-982f-371021c2ae46 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-aa30a084-718c-4fb1-a16c-f274b2f4386d-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "cinder-7855ceeb-3151-40b9-8012-4e8dea3650fc-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-7855ceeb-3151-40b9-8012-4e8dea3650fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:54 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da" returned: 0 in 0.273s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "cinder-quobyte-7855ceeb-3151-40b9-8012-4e8dea3650fc" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330e3a0c-8e5e-4269-bbf0-ed92737d31ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a0d90b-8ef3-4821-b095-14f9cbd714da', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa01896-2688-4f80-b3f6-e3ed3bea9567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:54 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Volume volume-15a0d90b-8ef3-4821-b095-14f9cbd714da (15a0d90b-8ef3-4821-b095-14f9cbd714da): created successfully Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa01896-2688-4f80-b3f6-e3ed3bea9567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Flow 'volume_create_manager' (af543176-255a-4e23-9e00-6b1993ea0430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-7855ceeb-3151-40b9-8012-4e8dea3650fc" acquired by "delete_volume" :: waited 0.040s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:54 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-87554946-2aae-45fe-9a82-90ca88e42997 tempest-ProjectReaderTests-838257960 None] Created volume successfully. Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ac7b9f-e597-4cdd-9f04-831b7030ba2f]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:54 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc Nov 05 22:37:54 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:54 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc" returned: 0 in 0.365s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:54 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:55 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc Nov 05 22:37:55 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:55 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-7855ceeb-3151-40b9-8012-4e8dea3650fc" returned: 0 in 0.234s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-quobyte-7855ceeb-3151-40b9-8012-4e8dea3650fc" released by "delete_volume" :: held 0.647s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Created reservations ['a539c982-4dd9-4be1-876c-024aa21992bc', 'a1aaf5d1-cfff-4eb8-add6-fe5d6900d931', 'a8478320-238e-44ad-bb32-6ac10ddbe441', 'a4a576a5-2b74-4d35-85a0-8026c3d05591'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:55 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:55 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:55 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.247s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:55 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Deleted volume successfully. Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-8d881439-1ecf-444e-8006-0a87e6412195 tempest-SnapshotDependencyTests-633086996 None] Lock "cinder-7855ceeb-3151-40b9-8012-4e8dea3650fc-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Acquiring lock "cinder-15a0d90b-8ef3-4821-b095-14f9cbd714da-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-15a0d90b-8ef3-4821-b095-14f9cbd714da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Acquiring lock "cinder-quobyte-15a0d90b-8ef3-4821-b095-14f9cbd714da" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-quobyte-15a0d90b-8ef3-4821-b095-14f9cbd714da" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c9069b-b51f-445f-adcc-a100f1cafde6]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:55 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:56 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da Nov 05 22:37:56 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:56 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da" returned: 0 in 0.360s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:56 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da Nov 05 22:37:56 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:56 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-15a0d90b-8ef3-4821-b095-14f9cbd714da" returned: 0 in 0.274s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-quobyte-15a0d90b-8ef3-4821-b095-14f9cbd714da" released by "delete_volume" :: held 0.682s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Created reservations ['713f382e-4d1b-4037-938c-3ea2c3942c69', 'a23bd2e4-e6dd-4e51-85c2-f70cc0c0944c', '92a919d8-f7e0-44bb-81c0-6ad2224bbc14', '01e360dc-51a1-4e37-a551-fdf13ecc8add'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:56 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:56 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:56 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.268s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:56 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Deleted volume successfully. Nov 05 22:37:56 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-551044d2-e0df-4850-8505-283e1fc37ff3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-15a0d90b-8ef3-4821-b095-14f9cbd714da-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Flow 'volume_create_manager' (6dafdf1f-3f24-4f30-9771-3266cfbe0941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00bcdcd-b7fc-4e4b-b414-cec8ef5ea27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00bcdcd-b7fc-4e4b-b414-cec8ef5ea27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441531827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56fe031c-7aa4-474f-b68e-d87f503cf8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6dc03308174d60b2c1a00eac10fb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:57Z,use_quota=True,user_id='ac6690018bb44812bfcd131a7428f052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4fa31b-f778-4bf5-bcbc-e9d52c6c0950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4fa31b-f778-4bf5-bcbc-e9d52c6c0950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d978b3-90b1-4a02-b348-f33df2d046dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d978b3-90b1-4a02-b348-f33df2d046dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56fe031c-7aa4-474f-b68e-d87f503cf8fc', 'volume_name': 'volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe4cc88-74a5-49df-928b-9c2b61dc8c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe4cc88-74a5-49df-928b-9c2b61dc8c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507e68cd-1512-416e-97d9-bda258e6ee3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:57 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Volume 56fe031c-7aa4-474f-b68e-d87f503cf8fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc', 'volume_size': 1} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441531827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56fe031c-7aa4-474f-b68e-d87f503cf8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6dc03308174d60b2c1a00eac10fb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:37:57Z,use_quota=True,user_id='ac6690018bb44812bfcd131a7428f052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Creating volume 56fe031c-7aa4-474f-b68e-d87f503cf8fc {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:37:57 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:57 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc 1073741824 Nov 05 22:37:57 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:57 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:37:57 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:57 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.263s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG oslo_service.periodic_task [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] Running periodic task VolumeManager._thread_info {{(pid=87122) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread count: 28 {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:37:57 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-95978132-04d2-4ab1-b41f-f6dfc49d0097 None None] thread info: [<_MainThread(MainThread, started 128570156626048)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87122) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:37:58 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc 1073741824" returned: 0 in 0.477s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:58 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc Nov 05 22:37:58 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:37:58 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Nov 05 22:37:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc" returned: 0 in 0.241s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:37:58 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:37:58 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:37:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507e68cd-1512-416e-97d9-bda258e6ee3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe841318-50b2-4c20-8235-9c08edd3ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:37:58 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Volume volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc (56fe031c-7aa4-474f-b68e-d87f503cf8fc): created successfully Nov 05 22:37:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe841318-50b2-4c20-8235-9c08edd3ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:37:58 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Flow 'volume_create_manager' (6dafdf1f-3f24-4f30-9771-3266cfbe0941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:37:58 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-be20d092-e14f-4e48-bcb9-601823bd4e75 tempest-ProjectReaderTests-838257960 None] Created volume successfully. Nov 05 22:37:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Acquiring lock "cinder-56fe031c-7aa4-474f-b68e-d87f503cf8fc-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Lock "cinder-56fe031c-7aa4-474f-b68e-d87f503cf8fc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Acquiring lock "cinder-quobyte-56fe031c-7aa4-474f-b68e-d87f503cf8fc" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:37:59 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Lock "cinder-quobyte-56fe031c-7aa4-474f-b68e-d87f503cf8fc" acquired by "delete_volume" :: waited 0.017s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:37:59 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8180027b-d364-45d5-9a36-f4c5fa87eb94]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:37:59 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:37:59 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc Nov 05 22:37:59 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:38:00 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc" returned: 0 in 0.430s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:38:00 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc Nov 05 22:38:00 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:38:00 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-56fe031c-7aa4-474f-b68e-d87f503cf8fc" returned: 0 in 0.250s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Lock "cinder-quobyte-56fe031c-7aa4-474f-b68e-d87f503cf8fc" released by "delete_volume" :: held 0.722s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Created reservations ['302c0f06-648e-478a-be54-c34d6dd46b03', '909ee0cc-c685-40d2-a8e0-c57b51e240f9', 'b6e92c16-2295-4633-b5d9-d5c9c0daf0b2', 'b0f4df1b-893e-46cc-9d70-11f7e77e7428'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:38:00 devstack sudo[108879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:38:00 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:38:00 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.290s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:38:00 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Deleted volume successfully. Nov 05 22:38:00 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-b980ec97-3f63-41de-ac7d-d7d71ba5b923 tempest-ProjectReaderTests-838257960 None] Lock "cinder-56fe031c-7aa4-474f-b68e-d87f503cf8fc-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87122) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Flow 'volume_create_manager' (524fd4d5-cffa-45ff-8f0f-6430cb7c2e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d58c4fc-9556-4100-b688-2e3ba88a5eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d58c4fc-9556-4100-b688-2e3ba88a5eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1834870350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1764c6f5-30dd-4dfb-84ae-980230bba724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6dc03308174d60b2c1a00eac10fb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:38:01Z,use_quota=True,user_id='ac6690018bb44812bfcd131a7428f052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a02cd1-6e16-4ba2-94b7-3e91270d7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a02cd1-6e16-4ba2-94b7-3e91270d7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2848d513-1f5e-4261-be2f-65485d8111cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2848d513-1f5e-4261-be2f-65485d8111cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1764c6f5-30dd-4dfb-84ae-980230bba724', 'volume_name': 'volume-1764c6f5-30dd-4dfb-84ae-980230bba724', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e43e78-b94d-45bb-baf5-004d889c924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e43e78-b94d-45bb-baf5-004d889c924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c57c590-5e13-4588-bbbc-f668b7490e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:38:01 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Volume 1764c6f5-30dd-4dfb-84ae-980230bba724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1764c6f5-30dd-4dfb-84ae-980230bba724', 'volume_size': 1} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1834870350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1764c6f5-30dd-4dfb-84ae-980230bba724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6dc03308174d60b2c1a00eac10fb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:38:01Z,use_quota=True,user_id='ac6690018bb44812bfcd131a7428f052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6124e685-22e5-42f3-9321-c71489b85dc1),volume_type_id=6124e685-22e5-42f3-9321-c71489b85dc1)}" {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.remotefs [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Creating volume 1764c6f5-30dd-4dfb-84ae-980230bba724 {{(pid=87122) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Selected osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 as target Quobyte volume. {{(pid=87122) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:38:01 devstack cinder-volume[87122]: INFO cinder.volume.drivers.remotefs [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] casted to osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041 Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724 1073741824 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:38:01 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724 1073741824 Nov 05 22:38:01 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:38:01 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724 1073741824" returned: 0 in 0.453s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:38:01 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:38:01 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724 Nov 05 22:38:01 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:38:02 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724" returned: 0 in 0.245s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'} {{(pid=87122) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c57c590-5e13-4588-bbbc-f668b7490e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1764c6f5-30dd-4dfb-84ae-980230bba724', 'volume_size': 1}' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c1eb43-5aba-4812-994d-7f9c8b4ee654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:38:02 devstack cinder-volume[87122]: INFO cinder.volume.flows.manager.create_volume [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Volume volume-1764c6f5-30dd-4dfb-84ae-980230bba724 (1764c6f5-30dd-4dfb-84ae-980230bba724): created successfully Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c1eb43-5aba-4812-994d-7f9c8b4ee654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87122) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Flow 'volume_create_manager' (524fd4d5-cffa-45ff-8f0f-6430cb7c2e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87122) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:38:02 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-66c37c0e-919f-4e1b-bbf6-cb3b49353d91 tempest-ProjectReaderTests-838257960 None] Created volume successfully. Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Acquiring lock "cinder-1764c6f5-30dd-4dfb-84ae-980230bba724-delete_volume" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-1764c6f5-30dd-4dfb-84ae-980230bba724-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Acquiring lock "cinder-quobyte-1764c6f5-30dd-4dfb-84ae-980230bba724" by "delete_volume" {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-quobyte-1764c6f5-30dd-4dfb-84ae-980230bba724" acquired by "delete_volume" :: waited 0.018s {{(pid=87122) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2f522a-c8aa-481c-871e-609051ad01da]: (4, 'qcow2') {{(pid=88382) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:38:02 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724 Nov 05 22:38:02 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:38:02 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724" returned: 0 in 0.371s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:38:02 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724 {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:38:02 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724 Nov 05 22:38:02 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:38:03 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa/volume-1764c6f5-30dd-4dfb-84ae-980230bba724" returned: 0 in 0.242s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-quobyte-1764c6f5-30dd-4dfb-84ae-980230bba724" released by "delete_volume" :: held 0.665s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG cinder.quota [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Created reservations ['52df96ec-9337-4816-8529-375cf0e95dd0', '369883d6-9bf1-4b19-bbe6-346218b3e74c', '059ba14f-8e8f-4417-9306-837da25e4475', '88fce07f-d540-4df7-a922-9f80d0c29aad'] {{(pid=87122) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041': None} {{(pid=87122) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG cinder.volume.drivers.quobyte [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-babfe217-1e9c-49cc-9d57-7138e6864041'] {{(pid=87122) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.lockutils [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87122) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:38:03 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa Nov 05 22:38:03 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:38:03 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG oslo_concurrency.processutils [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/94575640afc75f8cb91af17a713094aa" returned: 0 in 0.337s {{(pid=87122) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG cinder.manager [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Notifying Schedulers of capabilities ... {{(pid=87122) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:38:03 devstack cinder-volume[87122]: INFO cinder.volume.manager [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Deleted volume successfully. Nov 05 22:38:03 devstack cinder-volume[87122]: DEBUG cinder.coordination [None req-6a8baefe-d0d8-42e2-975c-9b016df4d8c3 tempest-ProjectReaderTests-838257960 None] Lock "cinder-1764c6f5-30dd-4dfb-84ae-980230bba724-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87122) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:38:13 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=77,cinder:INSERT=25,cinder:UPDATE=114,cinder:DELETE=5 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:38:13 devstack cinder-volume[87122]: DEBUG dbcounter [-] [87122] Writing DB stats cinder:SELECT=73,cinder:INSERT=28,cinder:UPDATE=103,cinder:DELETE=13 {{(pid=87122) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}